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ABSTRACT 
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development opportunities. The following outcomes are evaluated in 
this report: development of school improvement goals; project goal 
achievement; student outcomes and school factors; and identification 
of successful features. Methodology involved fall and spring 
administration of questionnaires to staff, staff interviews from a 
sample of 25 projects at 72 sites, and review of four quarterly 
individual project reports. Findings indicate that the program 
contributed to a substantial increase in the number and types of 
goal-setting activities, an increase in assessment activities, and a 
relative increase in staff participation in decision making. Personal 
involvement ^nd site leadership were most important factors for 
success; ar aer was realistic project goals. Interview findings 
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1. INTRODUCTION 



Background and Overview of HB 2020 

The School Improvement and Professional Development Program (SIPD) had its origins in 1987 in 
the recommendations of the Citizens Advisory Committee t'^- the Oregon Legislature's Jotrit 
Committee on Education. That advisory committee, througi < its recommendations, hoped to 
address tvvo nruilor concerns: the lack of professional growth opportunities within the careers 
of Individual teachers and workplace conditions Aat compromise the professional autonomy and 
effectiveness of all teachers.' 

As a result of the advisory committee's recommendations, the Oregon legislature enacted 
HB 2020 which directed the State Board of Education to estat)lish a School improvement and 
Professional Development Program (SIPD) to encourage initiatives which promote educational 
excellence in Oregon's public schools. Specifically SIPD Is based on the following rationale taken 
from HB 2020: 

1 . Further initiatives to promote educational excellence in the public schools are of vital 
importance in increasing student teaming and strengthening Oregon's ^onomy. 

2. The state should encourage and assist local school districts in their efforts to establish 
school goals through a process that Irwolves educators and members of the community 
and to develop effective tools to measure progress against those goals that will increase 
the public accountability of educational programs. 

3. New career opportunities for professional development are desirable to recognize skills, 
knowledge of their subject matter and other appropriate indicators of their professional 
growth. 

4. The establishment of site committees for the school district and for individual schools is 
desirable to encourage new initiatives In school improvement and shared decision making, 
the assessment of educational progress, and provkJe new and expanded opportunities fot 
teachers and to focHltate efforts to restructure the school workplace to provide educators 
wKh greater responsibility whRe Increasing their accountability. 

During the 1988-89 school year. 70 Oregon schools received funding for School Improvement and 
Professional Development projects. A variety of data collection activities were undertaken to 
address four basic evaluation questions: 

0 ^JkA/hat differences dkJ the School Improvement and Professional Development Program 
make with respect to the development of school improvement goals, the assessment of 
educatk)nal progress, opportunities for teachers' professional growth, and school-based 
management of improvement? 

0 To what extent dkj the projects reach the goals established in their applications? 
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0 What Impact did the projects have upon the improvement of student outcomes and the 
conditions of schooling that affect student outcomes? 

0 What aspects of project context, design, and Implementation affected project success? 

The Northwest Regional Educational Laboratory (NWREL) conducted the evaluation of the School 
improvement and Prdesslonal Developntent Program under a contract with the Oregon 
Department of Education. Data vvere collected from a late fall staff questionnaire, a spring staff 
quiistlonnaire, interviews with staff from a sample of 25 projects, and four quarterly reports 
completed by each project. In the follawing sections of this report, the findings from the data 
analysis are reported in relation to the four evaluation questions stated above. Prior to the 
presentation of these results, however, we describe the key characteristics of the programs, and 
the variables that were measured. 
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2. SUMMARY AND DISCUSSION OF FINDINGS 



The major conclusions which could be drawn from tho presentation of data and discussion are: 



Impact on Goal Development 

0 As a result of SIPD. there was a substantial Increase In the amount and types of activities 
related to goal setting. Tiiere was more teacher and community Invoivement in developing 
school goals, and greater agreement a^nong teachers about the school's Instructional 
goals. 



Impact on Assessment Activities 

0 As a result cf SIPD. there are more assessment activities, a stronger commitment to 
accountability, and a greater lnvo^</^ment of teachers In assessment activities. However, 
site committee members need more training In selecting assessment Instruments and In 
summarizing and In*?rpr6tlng the data they have collected. 



Impact on School-Based Management 

o As a result of SIPD. there are significant increases In the amount of collaboration among 
teachers and administrators In declsion-mdl<lng> curriculum planning, and problem 
solving. 

0 f taff members at SIPD schools saw the project SKe Committees as effective change 
agents who rept esented their interests, communicated effectivety with the school faculty, 
and had clear visions of how to Improve the school. 

0 Despite the tremendous Impact of HB 2020 on the nature and extent of decision-making 
opportunities and influence in professional development activiuj»s, faculty members still 
feel that the level of Involvement and influence they would like to have exceeds the level 
that they actually do have. 

0 Prior to HB 2020. school Improvement decisions had been predominantly the jurisdiction 
of school and district administrators, but were rK»w the province of both teachers and 
administrators. Being able to conceptualize a school Improvement program and 
Implement their decisions from start to finish incroased teachers' sense of effica cy and 
professionalism. 

0 Due to the practices set In place by the HB 2020 legislation, cotlaboration among staff is 
Staking place In areas broader than the school Improvement project. However, tne 
changes In staff collaboration are different for elementary, intentiedlate and high schools 
because of differences In the nonns, values, beliefs, and practices at the different school 
levels. 
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0 Faculty members In small districts felt they had more opportunity to influence decisions 
than faculty members In very large districts unless those districts were decentralized. 

0 Site committee members perceived themselves as having more decision opportunities 
than non-site committee members. Authority to make declsloris concerning allocation of 
funds was a critical aspect of their role. 

0 Teachers and administrators differed In their perceptions of teacher Influence In decision 
making, which results from the confusk}n about the difference between declston 
involvement and decision Influence. Principals referred to teacher Involvement on various 
committees when they spoke of how teachiers were able to influence decisions. Teachers, 
however, felt they were Involved In decision making, but nox Influential In the outcome. 

0 Although site committees were viewed as Integral to the schcd improvement process. It 
was the principal who was wklely regarded as the catalyst for change. Teachers tended to 
view their principals as instructional leaders, while principals saw themselves more as 
managers of people and resources. 



Impact on Professional Growth and Development 

0 As a result of their HB 2020 projects, staff perceived large increases in their involvement in 
professional growth activities. Responsibility for determining what professional 
development activities to offer and who would particlpata changed drannatically from a 
perception of "administrators only" to teachers and administrators." 

0 The availability of professional development acth/ltlea at a time when most districts have 
had to curtail staff development efforts was reported to be the most significant feature of 
the SIPD projects. 

0 Staff development activities at the Intermediate and high school levels were more 
successful if they nad a ready application to the subject niatter of IndlvkJual teachers. 

0 Although mini-grant projacts had to relate to the schooTs SIPD project goals, they allowed 
indivkJuals to design a project tailored to their specific needs and interests. For many 
indlvkJuals, this was the most satisfying aspect of the SIPD project. 



Accomplishment of Project Goals 

0 Most projects met at least some of their goals to some extent. Many of the projects had 
student outcome goals which were unrealistic In terms of signiflcant growth in one school 
year. Projects with intennediate goals such as staff developnnent, curriculum 
development, and restructuring made satisfactory progress toward their goals. Most 
projects could have benefitted from more technical assistance in summarizing and 
interpreting their data. 
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0 Site commKtees typically met twice each month and assumed most of the responsibility 
for collecting and Interpreting data on school Improvement needs, allocating resources for 
school Improvement activities, and determining eligibility for professlona' development 
mini-grants. Over half of the site committee members were either uncertain or agreed that 
their project effects would dissipate without continued external support. 



Improvdment of Student Outcomes 

o in terms of student outcomes, staff members perceived the greatest amount of progress In 
student achievement, followed by student attitudes and student behaviors. Perceived 
growth in these areas increased from the Fail 1988 to the Spring 1989. 



Project Characteristics Affecting Outcomes 

o Regression analysis of the Fail and Spring questionnaires indicated that the strongest 
predictors of positive project outcomes were personal Involvement in the SIPD project, 
goal setting processes, school climate, site committee leadership, and principal 
leadership. The strongest predictors of perceived SIPD project success were similar: site 
committee leadership, personal Involvement in the SIPD project, and professional 
development actlvltle.s. 



Summary of Interview Data 

The organizational literature speaks of schools as having distinct cultures with unique patterns of 
beliefs and expectations that are shared by members and that establish the nomis and rules 
governing the behavior of members. A school's culture is presumed to be in part a response to 
exigencies in the larger environment in the sense that norms and rules governing behavior are 
often dictated by constraints and contingencies imposed by regulatory agencies, and in part 
formed by the mix of people in the school. Practices in a school reflect the human response to 
external regulatory mechanisms and the beliefs that people cany around In their heads about the 
way things should be done - how one's work should be carried out and how one conducts 
oneself In that process. Differences from one school to another reflect the interaction between the 
people in the school and their environment. Efforts to implement fairly standard reform measures 
are expected to be somewhat different from school to school but because a school is conceived 
as having a unitary culture, the metamorphosis of change wKh its unifomn legislated requirements 
Is expected to result In a simUar set of practkies. Such a vision of schools is so sacrosanct that no 
one really questions whether It represents the reality of how schools work with regard to 
Implementing schoolwkie improvement projects. 

Schools, however, have not one culture but many. Conversations with teachers and 
* administrators in SIPD schools suggested that a more apt image of schools is an organization 
comprised of several often diverse occupational communities. The vMd descriptions of how 
faculty members came together and negotiated the specific features of their projects spoke to a 
different picture of how schools operate. The notion of there being multiple cultures operating 
simultaneously, each representing different values, beliefs, and expectatk>ns, and alongside a 
distrkst organizational culture (ofien reflected In the administrative structure of a school) more 
appropriately personifies the experiences of teachers as they described how they designed and 
Implemented their SIPD projects. High schools in partk;ular, with their distinct disciplinary cultures 
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where department practices often are predicated on the shared norms, values, and beliefs of the 
discipline, went about the process of Instituting change differently thfin elementary schools. The 
different (l.e., disciplinary) occupational communities In high schools are marked by distinctive 
work cultures. For high school teachers, coming together and discussing the shape or form of 
their SiPO project meant adopting a generic language that indivkluals couM use to ta!k about 
change. The process took time and for some large high schools, key actors involved In the 
schodwkle change efforts spoke of feeling that they were stMl in the initial stages of project 
implementatton. Coordinating people and activities during the project design phase took more 
time than most people had anticipated. Size often mDitated against their rate of progress as well as 
the complexity Involved in coordinating disparate groups of Individuals. Elementary schools, while 
not as diverse as high schools in terms of having distinct disciplinary communities, had different 
work cultures as well. Primary teachers and intermediate teachers often represented distinct work 
cultures with their own shared set of values, norms, and perspective making communication 
between, for example, kindergarten and sixth grade teachers difficult Hence, key actors in 
elementary schools also spoke of the importance of acquiring a common language that would 
enable them to come together and talk about change. Junior high and mkidie schools were 
organizationally the most diverse, often having a mix of faculty members - some with training as 
subject matter specialists and some with training as elementary teachers. A variety of often quite 
different occupational communities (and organizational role conflict) abounded In junior high and 
mkJdie schools resulting In a change process that dW not mirror either high schools or elementary 
schools. 

Viewing schools as organizations with muftiple occupational communities makes It possible to 
understand some of the differences found among SiPD schools, particularly differences related to 
site-based management, importantly, the IndMduals comprising the occupational communities In 
each of the SiPD schools are bound together by common values, interests, and a sense of 
tradition, and they frequently shared bonds of solidarity or mutual regard. The language members 
used to communicate with one another reflected not only a shared history of working together, but 
symbolized the group's kieas, thoughts and feelings about the way things are done around here." 
Not too surprisingly, each communltys quest for occupational self-controi and governance over 
work and the strategies employed to enhance their likelihood of gaining control was different and 
reflected tiie cultural mores or practices of the group. What these differences meant for 
Implementing a new governance structure Is reflected in both the process of selecting site 
committees and developing goals and the perceived ability of indivkluals to Increase their authority 
over their world of work. At a minimum, the proposed new governance structure blurred, or In 
some cases, removed the boundaries distinguishing extant work groups and reorganized 
Indivkluals Into different work teams, importantly. It also challenged ~ in many 
cases •- well-Institutionalized beliefs and practices by promoting a new way to gain occupational 
self-control and governance overwork. 
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3. PROGRAM DESCRIPTION 



Site Selection 

House BUI 2020 provided for a compotltiva application procedure for SIPD grants. Pour district 
size categories were created: Small (urxJerlOOO ADM), Medium (1000-3999 ADM). 
I^rge (4000-10.000 ADM), ar>d Very Ljirga (over 10,000 ADM). Sites were selected through a 
competKlve application process based upon district ADM and further subdivided Into grade level 
sub-categories. Thus, the applications from districts of a sImRar size and grade level were 
reviewed together. 

Based upon a $1000 per RE formula In the legislation, funds were provided for approxlnuitely 
seven percent of Oregon's teachere. The total amount of money availabie In each of the size 
categories was determined by multiplying the number of RE In each category by seven percent 
times $1000. Slightly less than two million dollars were available for awards In the 1988-89 school 
year. 

There were a total of 232 applications and grants were made to 70 sites. Forty-two of these were 
elementary, 1 1 were middle school or Junior high. 12 were senior highs, and 5 were others such 
as K-12 schools, ESDs, or a consortia of small schools. Implementation of SIPD projects was 
facilitated through technical assistance provided by the Oregon Department of Education and 
three Professional Development Centers located throughout the state. 



Research on School Improvement 

Space does not permit a full discussion or even an overview of the research on school 
improvement. Good overviews of the research are documented elsewhere, such as. Effective 
Schooling Practices: A Research Synthesis (School Improvement Program. Northwest Regional 
Educational Laboratory. 1984). Research suggests that school autonomy, strong leaderehlp. clear 
school goals, rigorous academic requirements, an orderly setting, teacher Involvement In school 
decision maidng. high parental involvement and Interest, and high expectations for student 
perfomrtance are features of schools which are strongly related to educational effectiveness. Most 
school Improvement efforts and reform nxyvements revolve around one or more of these features. 
The School Improvement and Professional Development Program (SIPD) Is no exception. 

The possibility for success of SIPD certainly exists-but Is there a reasonable probability for 
success? An Important study by the Education Commission of the States (ECS) suggests that 
there Is (Anderson and Odden. 1986). The ECS study of ten states strongly suggests that state 
Initiatives can have a strong local Impact if: 

1 . There Is general state pressure to improve 

2. There Is political support from leaders In both the executive and legislative branches 

3. Discretionary money Is available to local districts and schools 

4. There Is political support and appropriate organizational structure within the state 
department of education 
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5. The state department of education has a cdlegial relationship with local districts and 
schools 

6. There are adequate resources 

7. There Is a state effort to develop local capacity through technical assistance. 
Each of these factors Is. at least to some extent, a feature of SIPD. 

Overvlaw of Funded Projects 

While each of the 70 SIPD projects is unique, there are certain similarities in their major goals, and 
most sites had multiple goals. Tat}le 1 displays this retatlonship. 



Table 1. ^ 
SIPD Project Focus by District Size 



Size District 



Type Goals 


Small 


Medium 


L^rge 


Very Large 


Total 


Cunrlculum focus 


15 


26 


9 


3 


53 


Student focus 


19 


22 


15 


15 


71 


Instmctlonal or 


35 


40 


31 


29 


135 



Governance focus 

* Small - Undtr 1 ,000 AOM, Mtdlum - 1 , 000 to 4,000 AOM. Urgt - 10.000 AOM and Vary Large - Ovar 

10,000 ADM 



As Table 1 shows, slightly more than half of the goals were In the Instructional or governance 
category. The other goals were divided between curriculum and student-related goals, with the 
greater portion being devoted to student concerns. Examples of goals with a curriculum focus 
include: 

To establish a computer IHency curriculum, 

To align the curriculum so that Instructional activities and assessment Items 
address the same body of knowledge, 

Examples of goals with a student focus are: 

To Improve the competency level o* students In spelling, study skills and critical 
thinking skills. 

To develop a program that recognizes positive student behavior and reduces the 
number of referrals. 
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Exampl«8 of goals wfih an Instructional or governance focus Include: 



To provide professional development activities that result In experlentM learning. 

To Increase fhe (opportunity for teachars to develop leadership skills. 

To Increase community Involvement In the school. 

To Increase staff Involvement In school management and decision-making. 

In summary, most pro|octs had from three to five goals. Some schools tended to focus all their 
goals In one area, e.g., student outcomes, but most of the schools designed a project that cut 
across two or three areas. For Instance, there would be a goal to increase student achievement 
(student focus), a goal to provide staff development in cooperative teaming techniques 
(instructional focus), and a goal to Increase teacher involvement In school decision-mal<ing 
(governance focus). Usually the goals were inter-related, but this was not always the case. 
Oftentimes the student outcome goals were based on prior attainment of staff development or 
curriculum development goals. Thus, as we will see later, within a nine-month school year It was 
unrealistic to expect teachers to learn about and apply new curricula and methods that would have 
an immediate impact on student attitudes, behaviors, or achievement. 
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4. SOURCES OF DATA 



Data for this evaluation were coHected from several sources: a late fall staff questionnaire, a spring 
staff questionnaire, inten/iews with staff from a sample of 25 projects, and four quarteriy reports 
completed by each project. 

Fall Questionnaire 

In December 1988,80urces of Data staff from participating schools were asked to respond to a 
136-ltem questionnaire regarding the conditions in their school before the SIPD project and at 
present, the management of school improvement before SIPD and at present, the effects of SIPD 
up to the present time, and their perceptions of the SIPD project. Site committee members 
responded to an additional 17 questions concerning the frequency of their meetings and their 
responsibilities. A total of 1,930 persons responded to the fall questionnaire, for a return rate of 
98 percent. 

Spring Questionnaire 

A similar questionnaire was mailed to staff from the 70 projects in April 1989. The spring 
questionnaire consisted of 1 1 4 items measuring conditions in the school at the present time, the 
effects of the SIPD project, perceptions of the SIPD project, and desired and actual school site 
decision-making processes. An additional seven questknis were asked of site committee 
members concerning their meeting frequency, project implementation, and future school 
Improvement plans. A total of 1 ,671 staff responded to the spring questionnaire, for a total return 
rate of 84 percent. 

Tables 2 through 5 show the number and percentage of respondents to each sun/ey, broken out 
by staff position, school level, district size, and site committee membership. 

Quarterly Reports 

Four quarterly reports were requested from each of the 70 sites. These reports asked for 
Infomiatlon concerning site committee activities in the areas of governance, goals, professional 
development, curriculum and instruction, as well as mini-grant reports and outcome data sheets. 
Report completion was excellent for the first three quarters, but seven projects did not complete 
fourth quarter reports. 



Interviews 

SKe visits were made to a sample of 25 schools from January through March 1989. The sample 
was selected to achieve a balance of elementary, intermediate, and secondary schools as well as 
geographte representation across eastern Oregon, southwestern Oregon, and northwestern 
Oregon. The purpose of the Interviews was to give faculty members an opportunity, using a 
structured but open response format, to discuss the implementatk)n of their schooTs SIPD project. 
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Interviews were conducted wtth randonily selected members of the site committee, with Individuals 
not on the site committee, with recipients of mini-grants, with the site committee chair, and with the 
school principal. A total of 192 intendews were conducted, 76 at the elementary school level, 28 at 
the middle school/junior high level, and 88 at the high school level. 



Table 2. 

Survey Respondents by Position 

Fall Survey Spring Survey 

Position Number Percent Number Percent 



Teacher 


1640 


85 


1416 


86 


Administrator 


98 


5 


80 


5 


Media Specialist 


45 


2 


45 


3 


Counselor 


74 


4 


57 


3 


Other 


68 


4 


51 


3 



Level 



Table 3. 

Survey Respondents by School Level 



Fall Survey 
Number Percent 



Spring Survey 
Number Percent 



Elementary 
Intemiediate 
High School 
Other 



807 
287 
731 
103 



42 
15 
38 
S 



747 
247 

£•99 
75 



45 
15 
36 
4 
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District size 



Tablo 4. 

Survey Respondents by District Size 



Fall Survty 
Number Percent 



spring Survey 
Number Percent 



Under 1,000 


398 


21 


342 


20 


1,000 - 4,000 


670 


35 


598 


36 


4,000 - 10,000 


513 


27 


429 


|26 


Over 10,000 


347 


18 


299 


18 



Tables. 

Survey Respondents by Site Committee Membershilp 



Potit'on 



Fail Survey 
Number Percent 



Spring Survey 
Number Percent 



Site Committee Chair 74 
Site Committee Member 496 
Non-site Committee 1356 



4 

26 
70 



67 
301 
1186 



4 

20 
76 
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5. RESULTS AND DISCUSSION: 
IMPACT ON SCHOOLS 



In this section, we look at the Impact of the SIPD program on the development of school 
improvement goals, the assessment of educational progress, school-based management of 
improvement and opportunities for teachers' professional growth. 



Development of School Improvement Goals 



Goal Setting Processes 

One of the Intents of HB 2020 was to assist schools in establishing school goals through a 
process that involved educators and members of the community. The process typically involved 
the following steps: 

1 . Election or selection of a site committee 

2. Discussion of problem areas by entire faculty 

3. Assembly of statistical data and test scores 

4. Surveys of staff, students, and parents 

5. Drafting of goals by the site committee 

6. Flnni selection or approval of the goals by the entire faculty 

A swiri of activity best characterizes the goal development process In each of the SIPD schools 
visited. This activity began at the time schools decided to apply for a 2020 grant and, according to 
interviewees, the way faculty worked on the grant appltoatlon set the stage for how faculty 
members would work together after the grant had been awarded. Initial Interest In applying for the 
grant began small in the sense that a small group of faculty members gathered to discuss the grant 
and the application process. Most often a central office administrator had apprised the school 
principal about the grant and the princ pal in turn met with faculty members who were. In the eyes 
of their coileagues, the group who was always Involved In and excited about school Improvement 
activities. Not surprisingly, this group of indivkJuals ultimately became kjentlfled as the schooTs 
harbinger of and catalyst for change. In many schools, the group was elected by colleagues as 
their school's 2020 site committee. 

Unlike school goals that had been developed in the past, the goal development process In the 
majority of schools visited involved the entire faculty and oftentimes members of the community. 
Site committees were responsible for overseeing this activity and, regardless of school level, 
approached the task with fervid determlnatton that the Interests and needs of the school would be 
reflected in the goai(s) selected. Zealous In their behavkK, site committee members described 
how they conducted a needs assessment that resulted In the Uentlficatlon of their schooTs SIPD 
goals. Depending on school size and organizational complexity, site committees initially either 
held entire school faculty meetings or Interviewed facidty members to soitelt their concerns about 
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school-related Issues that needed to be addressed. Elementary school site committees were more 
Inclined to employ a whole school taculty meeting as the forum for discussing issues. High school 
site committees were more apt to rely Initially on Individual Interviews with faculty members to 
solicit their optnlons about pressing concerns and then nteet as a total site committee to determine 
faculty members' priorities and develop goals. Middle school/lunior high school site committees 
tended to use the entire school faculty meeting approach to develop goals; however, they 
generally divided the faculty Into smaH groups first to discuss issues and concerns and then 
brought the group together to develop priortties and decide on schoolwide goals. 

Regardless of the method employed, all faculty members inten/lewed felt that all school staff were 
Involved In the goal development process. For many intendewees this was the first time their views 
had been solicited and taken Into consideration. As a result, the goals adopted were felt by 
interviewees to represent the Interests and concerns of everyone. Not surprisingly, Interviewees 
commented that they felt a greater sense of commitment toward reaching the goals because the 
SiPD goals were "their goals." 



Changes in Goal Setting Processes 

Seven items on the Fall questionnaire and six items on the Spring questionnaire dealt with the goal 
setting process. Table 6 shows the descriptive statistics for each item before the SIPD project, in 
the Fail of 1988. and the Spring of 1989. There are large Increases from "Before SIPD" to "Fall 
1988" In the percent of staff who agree with these statements, but there Is little change from 
'Fail 1988" to "Spring l989"inthepercentof staff who agree with these statements. This would 
be expected since there was little additional goal setting activity once the projects began. 
However, it seems that there was a substantial Increase In the amount and type of activity related 
to goal setting, as well as Improvement In the degree of collaboration surrounding matters of 
educational goal setting since the start of the SIPD pro|ects. 

It appears that the Intent of more teacher Involvement and more community Involvement In 
developing school goals has been realized. Further, there Is greater agreement among teachers 
cn the school's Instmctlonai goals, and these goals directly influence what goes on in the school. 
Responses to specific items are grapt.ed In Figure 1 through Figure 7. 

The fact that SIPD goals were, according to interviewees, "their goals" distinguishes SIPD goals 
from the majority of school goals many of the schools had prior to MB 2020 Indeed, most goals 
adopted as school goals had been district goals or an adaptation of the district's goals and the 
goal development process was. according to teachers, little more than a sanctbning of these 
goals. According to inten/lewees, pre>^ous school goals generally were abstract or vague and not 
meaningful In the sense that teachers knew how to reach the goals. Even though principals of 
SIPD schools were actively Involved In school Improvement activities and In particular were 
credited with having a dear vlston of where they wanted to take the school and the knowledge of 
how to get there, IntenHewees kept coming back to the fact that the SIPD goals were their goals." 
not administrator's or central office's goals, and that this Is what made SIPD projects different. 
Moreover, because of their Involvenwit In the goal development process, most Interviewees saM 
they had a general sense of how they were going to reach ttie goals. And for IndlvkJuals in schools 
that had gone through the OTE goal development process, there '^s a level of confidence that 
involving faculty In goal development activities made a difference In a school being able to reach 
its goals. 
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Table 6. 
Goal Setting Process 



Item BtfortSIPD Fall 1988 Spring 1989 

Mean S.D. Mtan S.O. Mean S.D. 



High level of agreement 
on Instructional goals 

among teachers 2.79 .88 2.42 .90 2.43 .92 

Ideas from community 
groups are sought in 

problem solving efforts 2.92 .87 2.56 .91 2.63 .88 

Community Involvement 
is sought in developing 

school goals 2.83 .89 2.41 .92 

We \ook ahead and 
doni spend all day 

responding to problems 2.85 .96 2.37 .95 2.41 .94 

Goals for school 
improvement have the 
backing of all teachers 

in this school 2.59 .92 2.09 .89 2.11 .96 

Goals for school 
improvement directly 

influence what goes on 2.57 .90 2.04 .86 1.96 .83 

Strong commKment to 
identify the most significant 

needs for Improvement 2.62 .95 1.96 .89 2.03 .91 



1 • Strongly AQrt* 
2-AgrM 

3 • UnMrtain 

4 • OiMgrM 

5 - Strongly OlugrM 
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Figure 1. There is a high ievel of agreement on instructional goais among teachers. 
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Figure 2. ideas from community groups are sought in problem-soiving efforts. 
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14 »« 



Disagree 



Figure 3. Community involvement is sougiit in developing the school's goals. 
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Note: Qufstlon w«i not In Spring turvty 

FIgurt 4. We look ahead; we don't spend ail oi r time responding to daily problems. 
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Figure 5. Goals for school Improvement have the tjacklng of all teachers In this school. 
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Figure 6. Goals for school Improvement directly influence what goes on in this school. 
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Figurt 7. There is a strong commitment to Identify needs for Improvement In this school. 



This was particularly true in elementary schools that had selected goals that were academically 
oriented, e.g., an art program, a writing program, a music program, etc. In these schools, 
interviewees were able to relate their professional deveiopment activities and their classroom 
activities to specific school goals. In discussions with faculty in these schools, one had the feeling 
that the school possessed a sense of 'mission' and the entire faculty was Involved In achieving the 
goals they had set for themselves. This ability to cohere around school goals In a way that 
communicated that everyone was working together toward the attainment of the school's goals 
was less likely In schools where there were multlpie goals that were not instructlonally or 
academteaily oriented. Although this was the case in some elementary schools visited, the 
situation most often occurred In mkJdie school/junior high schools and In high schools. 
Organlzattonal diversity accounts In large part for this difference In goal orientation. High schools 
In particular are structurally differentiated organizations with faculty representing diverse 
backgrounds. Such circumstances have resulted in a greater tendency toward the development of 
multiple goals that represent the interests and concerns of different constituencies. The goals 
developed generally are more diffuse and they have tended to be more process oriented rather 
than centering on academk: excellence. In these schools. Interviewees were less likely to be able 
to cite the goals as much as they couM discuss the goal development process and their 
Involvement in a variety of professional development activities to reach one or more of the goals. 



Clianges in Goal Setting Influence 

Five Items on the Fall questionnaire asked what groups had the greatest Influence on goal setting 
activities before the SiPD project and at the present time. AsRgures 8 through 12 Illustrate, 
nearly half of the respondents thought "Administrators Only had the most Influence before SiPD, 
but thuse percentages dropped dramatically by late Fall of 1988. The gains were seen in the 
category of Teachers and School Administrators." where the percentages of respondents 
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choosing this category ranged from 66 percent to 77 percent across the five items. Percentages 
of staff choosing Teachers Only" were smali, and changed ilttie across the two time points. Thus, 
the goal of increasing teacher involvement In goal setting was met. to the extent that this 
involvement meant a greater cdlat^oration between teachers and school administrators. 

In sum, goal development in each of the schools visited was a dynamic process that was 
orchestrated by site committees. All faculty members were involved although involvement was 
handled differently In elementary schools, middle schools/Junior high schools, and high schools. 
Faculty members attributed their level of commitment to reaching the goals to their influence and 
Involvement in the goal development process. 
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Figure 8. The group which has the greatest influence on collecting data for Improvement needs. 
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Figure 9. The group which has the greatest influence on interpreting improvement needs data. 
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Figure 10. The group which has the greatest influence on deciding specific Improvement areas. 
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Figure 1 1. The group which has the greatest Influence on establishing school Improvement goals. 
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Figure 12. The group which has the greatest Influence on determining criteria for goals. 
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Assessment of Educational Progress of 
School Programs and Students 



Information about assessment activities was available from the two questionnaires, the quarterly 
reports, and the onsite Interviews. 

Questionnaire Data 

The Fall questionnaire asl<ed seven questions regarding asse^^ment, and three of these questions 
were repeated In the Spring. Figures 13 arxJ 14 show sizeable Increases from 'Before SIPD' to 
Tall 1988" In the percent of atari who agree that information Is collected from a variety of sources 
and used to help make decisions, and who agree that there Is a strong commitment to 
accountability In their school. There is a slight increase from Fall 1988 to Spring 1989 in the 
percent of staff who agree that information and data they collect are used to monitor the progress 
of the SIPD project (Figure IS). The percent of staff who felt that Teachers and School 
Administrators* gathered data to note progress toward reaching school improvement goals 
increased from 31 percent 'Before SIPD' to 64 percent in 'Fall 1988' (Figure 16). Taken together, 
these data indicate that there are more assessment activities since the SIPD project began, and 
teachers are more likely to be involved in them than they were before the SIPD project. 

Three items on the Site Committee portion of the Fall questionnaire asked about the assessment 
and evaluation activities of the site committee. More than two-thirds of the respondents felt that 
the site commttee had sole responsibility or most of the responsibility In gathering data, evaluating 
the program, and determining if goals had been met (See Rgures 17 through 19). 



Percent 




Agree Uncertain Disaoree 



Figure 13. Informatksn collected from many sources is used to make decisions at this school. 
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Figure 14. There is a strong commitment to accountability at this school. 
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Figure 15. I collected Information and data used to monitor the progress of the 2020 project. 
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Figure 16. Data are gathered to note progress toward reaching school improvement goals. 
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Figure 17. Responsibility for gathering data to note progress toward school goals. 
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Figure 18. Site committee responsibility for evaluating school Improvement programs. 
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Figure 19. Site committee detennlnes if school Improvement goals have been met. 
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Quarterly Report Data 



Data from the fourth quarter reports Indicate wide variation across projects in attention to 
evaluation activities. At one extreme are the projects that hired evaluation consultants to collect 
and summarize information about each goal area. Only eight projects included comprehensive 
tables and graphs of data, complete with summaries and conclusions. 

At the other extreme were projects that omitted any data summary whatsoever in the fourth quarter 
report. In between were the bulk of the projects which included data pertaining to some goats but 
not others, or who included questionnaire or test score data tables with no summary or 
Interpretation of what It meant In relation to their goals. Thus, although the Fall and Spring 
questionnaires indicated a sut>stantlal increase in assessment activities as a result of SiPD, there is 
still a lot of room for improvement, especially In summarizing and interpreting the data collected. 

Another aspect of SiPD assessment is the fact that several projects had so many ambitious goats 
that it was difficult for them to implement all the activities they had intended, much less gather data 
to ascertain their effects. Many projects set goals in the affective domain, which are notoriously 
difficult to measure or show significant gains in the short period of one academic year. SIPD site 
committee members could probably benefit from more training or technical assistance in selecting 
Instruments to assess their project effects, but more importantly, they need more help in 
summarizing and interpreting their data. 



Interview Data 

Contrary to faculty members responses on both the fall and spring surveys that assessment 
Infonnation was being collected from a variety of sources to guide Implementation of their SiPD 
project and to determine if project goals were being met, mtM interviewees had little idea if such 
data were in fact gathered. Most assumed that It was, but could not identify any specific 
assessment or evaluation practices to confimn their assumptions. This was true for most schools 
at ait tevels and for both site and non>slte committee members. Of all the interview questions, this 
area in particular caused respondents to ask the Interviewer questions about as&sssment and 
evaluation activities. After a series of probes back and forth, interviewees were able to identify 
certain practices, e.g., collecting writing samples, examining students test scores In certain areas, 
kJentifyIng number of participants attending workshops and conferences, collecting data on 
student absenteeism, etc., that they assumed were lndk»tors of change. However, most 
Interviewees dM not know if data being gathered related to the general assessment of project 
progress on any dimenston or to the evaluation of project goal attainment. By far, this was the 
weakest link in most of the projects, and. unfortunately. It called into questton whether there was a 
relattonship between needs assessment goal development, project actlvitiea and goal attainment. 
This would not have been as great a concern If only non>slte committee members had expressed 
uncertainty about assessment and evaluatk>n activities. 

In terms of level of awareness, non-site committee interviewees had the vaguest understanding of 
assessment and evaluation activities. They coukJ, when probed, identify some practtoes but on the 
whole they dkJ not know how to utRize the information. According to interviewees, because most 
project goals and activities centered on school-related issues and concerns, data gathering at the 
classroom level was minimal. As a matter of importance, this Is the level where the majority of 
teachers focus their attention on a day-to^ay basis, so It is perhaps not too surprising that 
teachers wouki not know much about school-related assessment activities or the relai!on8hip 
between classroom activities and (schoolwkJe) project goal attainment. 
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An exception to this was In a few elementary schools where the entire school was Involved In a 
very specific project, e.g.. music, art. math, writing. In these schools. Interviewees were Inclined to 
actually share - during the Interview - samples of students' wort( to demonstrate the l(lnd of 
Information that was being collected on an origoing basis. At these sites, interviewees did see a 
relationship between project goals, classroom activities, and assessment However, when asl<ed 
how the viork samples were being used to modify goal objectives or to determine H goals were 
being reached, most non-site inten/iewees did not know but they were qulcl( to point out that this 
was a responslbHity of the site committee. 

This was not the case when outside consultants were part of the ongoing professional 
development training In a school. In this situation, the consultants woriced with all faculty members 
on how to use work samples to modify Instnjction and detennlne If project goals had been 
reached. When this occurred, non-site committee Inten/iewees could articulate what they had 
learned. This was dearty the case, for example, at an elementary school that hired two consultants 
to work with faculty on "writing across the curriculum." Here, hkSJty members were being trained 
In how to utilize Information from writing samples to modify their writing curricula. As well, when a 
school hired an evaluation consultant to wort( with faculty on the evaluatkm component of their 
SIPD project, non-site inten/iewees saw the relationship between project goals and activities and 
how goal attainment was being assessed. Of the 25 sites visited, this situation occurred only 
once. In a small elementary school located In a very small district. According to all Interviewees In 
this school, hiring the evaluation consultant deariy made a difference In their being able to evaluate 
their progress toward reaching their SIPD project goals. 

Non-site inten/iewees at the high school level were the least familiar with SIPD assessment 
activities. Most were unable to identify any specific Infonnatkm being gathered. Middle 
school/junior high school non-site Inten/iewees fell somewhere In between In tenns of level of 
awareness. An exception to this occuned at one junk>r high school where the principal had a 
doctorate and was knowledgeable about assessment and evaluatton &ctivitles and had made sure 
that all staff knew not only what the project goals were, but knew how to assess goal attainment. 
The principal In this school was also the site committee chair and was quite actively Involved In 
helping staff reach their SIPD project goals. At this school, all Inten/iewees could talk about 
assessment activities. 

As noted In an earlier discussion, site committee members were not appreciably more Informed or 
knowledgeable about assessment and evaluatton activities and how to use the Information than 
non-site committee members. Most committee members talked aboiA outcome data and when 
probed, they often referred to student assessment data to be collected in May or June. Several 
site committee Interviewees also menttoned that students' wori( samples were being saved by 
teachers and woukl be reviewed In May or June. Site committee members who were responsible 
for producing the required quarteriy reports were the most infonned about assessment activities 
because each quarterly report required Infonnation on this topto. Notwithstanding this 
requirement, most site committee members stM coukJ not artknilate Just how they were going to 
evaluate their pr^ect or detennlne If SIPD goals had been reached. SImlar to non-site 
Inten/iewees, when probed, they could Mentlfy certain practtees, but they were unable to link the 
practices to goal attainment or evaluation of their project. 

In conclusion, the topics of assessment and evaluation were seemingly foreign to most 
Inten/iewees. Given their Importance In the leglslatton on the one hand and on a school being able 
to evaluate if change has occurred as a result of project activities on the other, It seems critical that 



SIPD Final Report 



28 



NWREL October 1989 



SIPD schools receive training or be required to u»e part of their grant award in this area. Although 
it is possible to build a ie^iable case for why data were not yet collected or why it Is premature to 
expect change to be tioilceable to the quantitative eye, the fact that so few interviewees could even 
cany on a conversation about assessment and evaluation activities suggests that more attention 
needs to be given to educating faculty on this topic. Regardless of specific project goals, faculty 
should have a clear idea about how to reach them, and importantly, how to know If they have 
reached them. 
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School-Based Management 



One of the major thrusts of the SIPD program was to irwve schools In the direction of school- 
based management. As a locally Implemented coilatx>rative management system this meant 
iiaving the faculty actively share In the educational planning and decision making of the school. 

The major rationale for Implementing school-based management was the belief that the closer a 
decision Is made to a student served by the decision, the better It is likely to serve the student. 
With adequate authority at the school level, many Important decisions affecting personnel, 
curriculum, and the use of resources can be made by people who are In the best position to make 
them. Through the Implementation of site committees composed of a principal, teachers, parents, 
community members, and occastonaliy students, IndMduals work together on the attainment of 
school related goals. This typteally has included responsibnity for deckling on the goals to their 
actual implementation and evaluation. By employing the vehicles of participation - open 
communication, interdependent responsibilities, team decision making, and problem 
solving ~ indlvkJuais involved in school-based management are expected to feel a heightened 
sense of Joint involvement and contribulton to decisions. At the school organization level, 
implementing some form of school-based management was intended to result in a mors cohesive 
organization with highly integrated work teams, good intergroup relations, less conflict, ai)d greater 
focus and consensus on organizational goals. 

Variation in the structure and operatkxi of school-based management program? in each of the 
SIPD schools was produced by the process of local needs assessment and program planning. 
District organization imperatives and constraints and contingencies imposed by the isrger 
environment in which the district operates also contributed to differences in the design and 
implementation of school-based management programs. 

Faculty members in alt 70 SIPD schools were asked questions relating to the design and operation 
of their schooTs site-based management system, interviews conducted in 25 schools asked 
faculty members to talk specificaliy about the nature and extent of collaboration and decision 
opportunities in their school and whether there had been a change In the locus of control over key 
decision domains that affect the work lives of teachers. 



Staff Collaboration and Decision Making 

Both the fail and spring questbnnaires asked se^en questkMis regarding staff collaboration and 
decision nruiking practices in schools. Table 7 s.h)ws the descriptive statistics for each item before 
the SIPD project, in the Fall of 1968, and in the Spring of 1969. The pattem of responses is similar 
to what we saw eariier on the Items related to goal setting; there are large increases in the amount 
of perceived collaboration among teachers and administrators from 'Before SIPD' to 'Fail 1988", 
but there is little change from Tali 1988' to 'Spring 1989." Thus, the major changes in staff 
perceptions occurred at the beginning of the project rather than during the course of 
implementation. Figures 20 through 26 further Illustrate these changes. 



ERIC 



SIPD Final Report 



30 

40 



NWREL October 1989 



Table 7. 
Staff Collaboration 

n«m BaforaSIPD Fall198S Spring 1989 

Mtan 8.D. Mean S.O. Mean S.D. 



Teachers and administrators 
wort< together on areas 
which are causing prot>lems 

and concerns in the school. 2.54 1.06 1.95 .91 2.03 .93 



Teaci'idrs have enough 
opportunity to influence 
decisions that affect 

their work. 2.88 1.06 2.38 1.06 2.39 1.06 

Teachers In this school 
generally feel supported by 

administrators. 2.67 1.13 2.27 1.05 2.28 1.05 



Cdlaboratlve cuniculum 
planning takes place in 

this school. 2.75 1.00 2.22 .97 2.28 .99 
Collaborative decision making 

takes place In this school. 2.83 .98 2.24 .95 2.23 .95 

Leadership in this school is 
more pedagogical and less 

nfuinagerial. 2.92 .97 2.64 1.01 2.57 .99 



The principal shows teachers 
how they can contribute 
to the schooTs mission 

through their Instruction. 3.03 .99 2.70 1.05 2.65 1.04 



K«y 



1 • Strongly AgrM 

» ' Uncertain 

4 • DiugrM 

5 • Strongly DisagrM 
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Figure 20. Teachers and administrators viork together on protilems and concerns in this school. 
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Figure 21. Teachers have enough opportunities to influence decisions that affect worl<. 
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Figure 22. Teachers in this school generally feel supported by administrators. 
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Figure 23. Collaborative curriculum planning tal<e8 place at this school. 
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Figure 24. Collatx}ratlve decision making takes place at this school. 
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Figure 25. Leadership In this school Is more pedagogical and less managerial. 
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Figure 26. The princlpai shows teachers how they can contribute to the schooTs mission. 



SIPD Project Leadership 

Both the Fali and Spring questionnaires asl<eci six questions regarding SIPD project leadership. 
Table 8 shows the descriptive statistics for each item for the Fail of 1988 and for the Spring of 1989. 
These items Indicate that both principals and site committees have played a prominent role in the 
change process In their schools. This response pattern Is expected given the role of site 
committees In each of the SIPD projects. The creation of site committees was a requirement of the 
legislation; they were to establish new lines of communication between administrators and 
teachers, between professionals and nonprofessionals, and between the school staff and the 
community, and they were responsible fbr the Initial conceptualization, design, and orchestration 
of their schooTs SIPD project. 

When the data In Table 8 are examined for differences between site committee members and 
nonmembers, site committee members are (not surprisingly) more likely to agree than 
nonmembers that they are catalysts for change, that they have a dear vision of how to Improve the 
school, that they share Information effectively, and that they represent the Interests of the entire 
faculty. Non-site committee members are more likely to say they are uncertain about these Issues, 
and are also more likely to view the principal as the one who decides which Issues regarding the 
project require teacher Input. 



SIPD Final Report 



35 



NWREL October 1989 



The Role of the Principal 



One of the distinctive characteristics of SIPD schools Is leadership, specifically principals, who In 
the eyes of their staff, are strong educational leaders. These principals, according to interviewees, 
have a dear vision of where they want to take their school and tt. i dear knowledge of how to get 
there. As judged by their own staff, principals of SIPD schools exhibited an array of leadership 
qualities - knowledge of schod problems, openness with staff, clarity of strength and purpose, 
and a willingness to Innovate. They were able to artk^ulate dear goals, exercise strong 
Instructional leadership, and they held high axpectattons and respect for students and teachers. 
Because of these qualities, many inten/iewees commented that their SIPD project was a natural 
extension of the direction their schod was already heading and they attributed this to the rde their 
principal had taken with regard to overall school improvement, not just those elements of their 
SIPD project. Faculty members also perceived that their principal was able to deal effectively with 
the demands and pressures from parents, with excessive administrative burdens, and with 
exigencies posed by the community. SIPD prindpals took pride in their schods and were inclined 
to include faculty In decisions that affected their woric. 

in schods where faculty felt they wori<ed as a team, where the principal was perceived more as 
leading and cdiaborating than managing, teachers Mentified the principal as the key to having 
been awarded the schod's SIPD grant. According to inten/iewees in these schods, principals 
were Instrumental In allocating the critical resources of time and personnel to enable staff to work 
together on their project application. With a cdiaboratlve woridng relationship in place, the stage 
had been set for their woridng together after the grant had been awarded. With rare exception, 
inten/iewees associated the success of this cdiaboratlve wori( environment to their principal. 
Comments such as "people oriented,' "process oriented," and "invested In schod improvement" 
were common descriptors of principals in SiPD schods. 

Although site committees were viewed most often as the catalyst for the project-related schod 
Improvement change process being UKdeitaken in their schod, it was the principal who vras wklety 
regarded as the key to schod Improvement. This was almost unK/ersaiiy the case In elementary 
schods, particularly elementary schods In small districts, and was most often the case in mkidle 
schod/junlor high schods, especially those In small to medium-sized decentralized districls. In 
high schods, the leadership attributes of the principal were kjentified by interviewees but the 
association between the SIPD project and the rde of the principal was not always clear. This is 
due to the size and organizational complexity of high schods, specifically the fact that at tite time 
of the inten/lews SiPD projects had not yet covered the landscapes of most high schods, i.e., not 
ail Interviewees were Intimately aware of all facets of their schooTs SiPD project and the rde of the 
principal vIs-a-vIs the project. 

An interesting paradox surfaced during the course of intenrtevring faculty members and 
administrators about the rde of their principal. Faculty members, as noted in a previous 
discussion, viewed their principals as educatk)nal leaders and attributed the schod climate, among 
other things, to the leadership abilities of the principal. Principals on the other hand, viewed 
themselves more as managers than as pedagogical leaders and ascribed the same schod 
attributes to their ability to manage their schods well. High schod principals In particular 
described themselves as managers and, because of their schooTs size and organizational 
complexity, dkl not view themselves as InstructkHial leaders. Their staffs dkl, however. The 
apparent contradiction may lie in one's Interpretatton of the rde of the principal aa a visionary, in 
the eyes of faculty members, the principal who had both foresight and the means to assist staff in 
achieving goals was a leader; in the eyes of principals, this same indivklual who had the 
wherewithal to guide his or her faculty on a schod Improvement course was a skilled manager of 
people and resources. 
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Regardless of the differences In how Interviewees characterized their principals, it was clear that 
the principal in the majority of SIPD schools was viewed by faculty members as a key actor in the 
school Improvement process being undertalcen In each of the schools visited. 



Item 



Table 8. 
SIPD Project Leadership 

Fail IMS 
Mean S.D. 



Spring 1989 
Mean S.D. 



The principal decides 
which Issues and problems 
regarding the 2020 project 
require teacher input. 

The principal plays a strong 
leadership role In the process 
of change and Improvement. 

The 2020 Site Committee Is a 
catalyst for meaningful change 
In this school. 

The 2020 Site Committee has a 
clear vision of how to Improve 
this school. 

The 2020 Site Committee shares 
Infonmatlon effectively with 
the school faculty. 

In its decision making, the 2020 
Site Committee represents the 
interests of the entire school 
faculty. 



3.67 1.07 



2.16 1.02 



2.05 .90 



2.33 



.89 



2.08 .94 



3.66 1.06 



2.16 1.05 



1.98 .92 



2.22 .92 



2.04 .95 



2.21 1.00 



2.21 1.02 



K.y 



1 • Strongly AgrM 

2 • AgrM 

3 • Unotruin 

4 • DiMgrt* 

5 • Strongly DiMgrM 
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Decision-Making Involvement and Influence 



The topic of decision-making Involvement and Influence has been central to most discussions 
concerning refonn In the workplace. Although the two words - Involvement and 
Influence - often are connoted as having the same Intent In the workplace, the terms translate 
Into quite difference practices In schools. 

Involvement In decision-making means to be merely Included In the decision-making process with 
limited ability to affect, regulate or control the actual outcome of events. For example, involvement 
Is a type of partlclpatk)n that may take the form of being asked an opinion, or voting on the 
selection of a single textbook from a small list of choices, or making a recommendation for a new 
taculty member, or discussing Kerns on a faculty agenda. 

Influence In decision-making means to have appreciably greater control over the decision process, 
to have the ability to bring about outcomes one feels are Important and essential. For example, a 
person with Influence solkslts the opinion of others by asking specific questions, or klentlfles the list 
of textbooks to be voted on by others, or reviews and develops criteria for evaluating applications 
for a new faculty position, or determines which potential Items for the faculty agenda will actually 
be Included on the agenda. 

Faculty members were asked on the spring questionnaire whether the level of Invoivemern 
influence they felt they had In four decision domains was the level they desired. For each area, 
respondents Indteated whether they preferred Influence Only, Involvement Only, Influence and 
Involvement, or No Influence Nor Involvement. Except for one item, faculty predominantly desired 
'Influence and invoh/ement." The percentage Indk^atlng this chotee as their Desired and Actual 
levels of influence/Involvement are graphed In Figures 27 through 30. As these figures Illustrate, In 
all but one decision area - determining other's teaching assignment - respondents wished for 
more Involvement and Influence than they felt they actually had. 

Of the four declskm domains, faculty members Indicated that the amount of involvement and 
Influence they have over 'CurTteulum and InstructkDn' decisions (Rgure 29) Is relatively close to 
what they desire. This is not surprising given that many of these kinds of decisions are 
classroom-related decisions. Decisions of this type are often made by an entire faculty, by 
departments within a school, or by Indlvkluals In a department or school. 

However, when decisions affect the operatkxi of an entire school, such as the "Personnel" and 
"School Budget and PoUcy" domains (Figures 27 and 28), the amount of Involvement and Influence 
teachers desire Is quite discrepant from the amount they feel they actually have. This too Is not 
surprising given the congeries of influence In a schooTs regulatory environment that pose 
constraints and contingencies on how schools are to operate. Influence from the schooTs 
regulatory environment and central office preclude teachers from being more Influential In the 
workplace, hence teacher's perceptions that they do not have much involvement and Influence In 
many school-related decisions. 

Of particular Importance and salience to the effects of HB 2020 on teacher's perceptions of their 
Influence on school-level declskHis is the domain of 'Staff Development/School Improvement" 
(Figure 30). Despite the tremendous Impact of HB 2020 on the nature and extent of 
decision-making opportunity and Influence In professtonai development activities, faculty members 
feel that the level of Involvement and Influence they would like to have In these kinds of decisions 
stm exceeds the level they feel they have. 
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Figure 27. Personnel decisions. 
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Figure 28. School budget and policy decision. 
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Figure 29. Curriculum and instruction decisions. 
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FIgurt 30. Staff deveiopment/schod Improvement decisions. 
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These findings are Important because the nature and extent of control teachers feel they have over 
their world of work, vis-a-vts what they would like to have, Is at the heart of Implementing a 
successful school-tMised management program. For a school-based management program to 
have more than symbolic meaning for teachers requires that teachers gain a greater share of 
authority to make decisions regarding their work and feel that their desired level of decision 
involvement and/or influence In matters that are Important for them is not discrepant from what 
they feel they actually have. 



Management of School Improvement 

Decisions about resource acqulsitkm and allocatk>n are critical to the development and 
Implementation of programs, partkiutarty new programs where addltk>nai resources may be 
necessary for start-up. Having control over these kinds of decisions Is paramount to the effective 
Implementation and management of school programs. One of the major features of HB 2020 was 
to change the extant decisional structure of schools. Using the context of school improvement 
projects as the vehicle for reform, the legislation sought to reorganize, not only schools but school 
districts, by altering traditional territorial ranges of authority or control. Speclfically. the locus of 
control over decisions concerning the management of school Improvement was to shift from 
traditional lines of authority to the schools themselves. Decisions about the allocation of resources 
and the broader Issue of fiscal management figured largely In legislators conceptions of the 
restructuring of the workplace. 

Schools competed for available SiPD resources through an appllcatk>n process that required them 
to demonstrate not only need but an ability to conceptualize school Improvement. Specifically, 
they had to be able to describe how they Intended to convert the monetary resources Into other 
Important resources such as personnel, materials, and infomnation to reach project goals. 
According to interviewees, discussions at the application stage took place In the schools and were 
conducted by faculty members who crossed occupational lines to work together on Important 
Issues related to the orchestration and implementation of their projects. This process became the 
undergirding for the restructuring of the workplace; It set the stage for change In the authority 
structure of schools. 

This Interview finding Is corroborated by a question that appeared in both the fall and spring 
surveys that asked respondents if a process was In place for fundamental change to happen in 
their school. Whereas only 31 percent of the respondents answered In the affirmative about 
conditions prior to HB 2020. a majority of respondents (70 percent) answered In the affirmative in 
the fall and again in the spring (73 percent). 

By the time SIPD grants were awarded, taculty members had already had some experience in 
coming together and negotiating specific features of their school improvement projects. The 
governance stmcture, at least as tar as school improvement was concerned, had bequn to shift. 
However, and this point Is critk»l for understanding how and why change was able to occur In 
schools, the extent to which occupational self-control was realized was predtoated on resource 
acqulsitton; without It, according to Interviewees, most school improvement projects could not 
have been undertaken. 

In tthe fail, when faculty members In ail 70 SIPD schools were asked If the locus of control over the 
management of school Improvement had changed from what had existed prior to Implementation 
of HB 2020 to the present time, they lndk»ted that Influence over a variety of aspects related to 
the manag<!>ment of school Improvement had indeed changed. Whereas school Improvement 
decisions had been predominantly the jurisdictkm of school and district administrators only prior to 
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HB 2020, they are now predominantly the province of teachers and school administrators (see 
Table 9). Administrators were more likely than teachers to believe, both before and after HB 2020. 
that both teachers and school administrators had Influence In school Improvenrwrt activities. 
SlmBariy, sKe committee members were nrore likely than nonmombers to believe that both 
teachers and school administrators had Influence in school Improvement activities after HB 2020 
began. 

This ma)or change In the authority structure ol schools was WerrtWed by teachers and 
administrators during Interviews as the single largest change that had taken place In their schools. 
Although teachers and school administrators in most schools had vrorked collaboratively on a 
variety of school Issues, most of the Inten/tewees had not ever recalled wortdng collaboratively on 
a major schodwide program before and attributed this change in modus operandi to the 
legislation. Resource acqulsrtton and being able to manage the resources were key factors In this 
shift of control. According to Interviewees, their dlscussk>ns took on a different meaning when 
resources were made available and declstons about allocatk>n were within their control. They also 
feft that their level of commitment toward reaching their goals had Increased because they were in 
control of Important decisions. In sum, being able to conceptualize a school improvement 
program and Implement their decisions from start to finish Increased educators' sense of efficacy 
and professionalism. 

Collaboration In Schools 

One of the questions that arises when reform ieglsiatlon has as one of Ks objectives to alter the 
extant structure of the wori<place but when monetary resources have been targeted for 
Implementation of specific programs Is, do faculty members feel that change has been more 
pervasive than just at the program level, I.e., Is the change that has occun'ed Isolated to just the 
contour of the program or Is there broader appllcatton? It Is easy, for example, to Imagine that 
resources may just drive change in a parttoular area and not touch other aspects of one's wori< life. 
This Is not uncommon when resources are tied directly to legislation that requires the 
Implementation of a particular type of program and are acquired through a competitive application 
process. Attention is focused almost entirely on satisfying the requirements of the legislation and 
activity Is directed toward implementing the particular features d the project. However, HB 2020 
cast Ks net much further and directed its attentk)n at changing the declston structure at the school 
level, speciflcaily the broad range of declston practices and processes that Impact teacher's work. 
Itb aim was broader than the school Improvement project. In prscttee, this translates into 
cdiaboratlon among faculty members on a broad range of deciskKi issues. 

As faculty IkXiicated in their response to questions about managing school improvement (Table 9). 
greater collaboration between teachers and school administrators had occurred around the Issues 
of Implementing and managing school Improventent activities as a result ol the legislation. When 
queried about the extensiveness of the change In woridng together. I.e.. had coliaboration among 
faculty members extended beyond the topte of school Improvement, a majority of respondents 
Indicated that subsequent to the Implementatkdn of HB 2020 they were wort<lng In groups on a 
variety of school issues (see Table 10). A change In practk^ had taken on a life beyond the 
scope of the specifk: school improvement project. Coliaboratk>n among faculty memtters 
established eariy in the appilcatkm procesa had extended Into other wort< domains. For many, this 
was a change from practices that had existed prior to HB 2020. The change to woridng together 
on a variety of school Issues was sustained over the school year. 

When asked how much progress had been made In the area of teacher coilegiailty that was 
Indirectly or directly attributable to HB 2020, 62 percent of the survey respoixlents In the Fall, and 
67 percent of the respondents In the Spring Indicated that one of the positive effects of HB 2020 
had been that a lot or moderate progress had been made in the area of teacher collegiatity. 
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Table 9. 

Influence on the Management of 
School Improvement Before and With HB 2020^ 

MMrt Bofort HB 2020 Mmh Fall 1988 

TMChtrt Admin Total Teachtrt Admin Total 

School & District 

Administrators 2.27 2.23 2.24 .96 .35 .90 
School Administrators 

Only 2.59 2.78 2.61 1.32 .74 1.27 
Teachers and School 

Administrators^ 3.09 3.81 3.13 6.55 8.61 6.68 

Teachers Only .35 .03 .32 .40 .19 .39 



Staff rtsponMS w«r« tallitd acroM 10 quattlonnair* Ittmt for taeh tim* point (txfor* HB 2020 and Fall 1988) 
by rttponM category (School and DitUlct Administrators, Scnool Administrators Only, Tsachars and School 
Administrators, Taaohars Only, Do Not Krtow). This tabia show* tha avaraga numbar of timas each rasponsa 
category was chosan across tha 10 aspacts of school Improvamant. 

Oiffaranoas batwaan tha two tima points wara statistically significant, p < .01 . 



Table 10. 
Staff Coll&boratlon by School Level 

(Percent of Respondents In Agreement)^ 

Prt 20202 Fall 1088 



Spring 1989 



Teachers and 
administrators work 
together on areas which 
are causing problems and 
concerns In the school 

Cdlaborattve decision 
making takes place In 
this school 

Collaborative curriculum 
planning takes place In 
this school 



Elementary 

Intermediate 

Secondary 



Elementary 

Intermediate 

Secondary 

Elementary 

Intermediate 

Secondary 



61 
74 
50 



46 

50 
31 

47 
56 
42 



85 
89 
78 



?6 
76 
60 

76 
81 
62 



81 
82 
78 



76 
76 
62 

73 
75 
57 



1 Hams dealing with a collaborative process at the school level are included In this ubie (Ol : 8, 9, 20, 21 , 32, 33; 
G2: 4, 3, 1 1). Percent responding 'Strongly Agrn* and 'Aoree* are combined for each point In time. 
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These findings are Important because they suggest that broad based structural change predicated 
on a new set of beliefs about occupational governance b not only a viable but an appropriate 
expectation to hold when considering major organizational change and renewal. Since 
occupational life Is shaped by specific contexts of wort(, when belief systems about work 
relationships change, a change In practices follows. However the process of changing (a group's) 
values and beliefs Is slow and not uniform across organizations, that Is, it Is not the same for all 
types of schools. 

High schools, especially large comprehensive high schools, are comprised of diverse disciplinary 
communities with relatively unique wort( cultures consisting of, among other things, task rituals, 
standards for proper and Improper behavior, and wori( codes which surround relatively routine 
practices. Collaboration among high school teachers usually occurs within disciplinary 
communities, not across. Hence attempts at Imposing schoolwlde stmcturai change at the high 
school level require working first within occupatk^nal communities. High school teachers' wort< 
cultures are so tied to basic tenets of the discipline that discussions concerning Innovation usually 
center on the discipline; teachers are receptive to change If they can see its application to the 
curriculum. Pedagogy Is seen as the vehtole for Implementing curriculum; it too is Intricately 
woven to (often Instituttonalized) disciplinary practtees. A change In beliefs about the advantages 
of cross-dlsclpllnary collaboration Is thus a slow process. This artifact of high schools Is not as 
prominent at the other two levels of the school organization. 

Elementary schools represent a much more homogeneous wori< culture although differences 
abound in work style and organization of classrooms. Coliaboratlon among faculty members at 
the elementary level Is likely the modus operandi at most schools. Unless faculties are quite large, 
discussions among teachers and administrators about change occur regulariy and according to 
teachers Interviewed, a change In practices usually Is not resisted unless teachers are being asked 
to do more than they feel Is reasonable. Similarity In training enhances their ability to wori( 
together on a variety of Issues. According to Interviewees, mkMIe schools and junior high schools 
have beer. Involved In a restructuring process for the last 5-10 years and are setting themselves 
apait from both elementary and high schools by adopting a new philosophy for woridng with this 
adolescent age group. As a result, many mktdle school faculties have had some say (and 
practice) In the design of their program. Coliaboratlon has been ongoing and it has been 
interactive In the sense that dialog has often involved more than one school level (e.g., elementary 
and mkidle school). 

When survey data were reanalyzed by type of school (see Table 10), the verbal responses of 
elementary, junior hlgh/mkidie school, and high schoot faculty members to questions about 
collaboratlve practtees In their schools were corroborated. At all three points in time. Intermediate 
faculty members, followed by elementary faculty members Indicated that they are wori<lng together 
on a variety of Issues. A smaller peicentage of high school faculty numbers indicated that they are 
wortdng together on Issues Important to them. Importantly, for all three levels there have been 
nrajor shifts In percentage of affirmative responses from perceK/ed wori< condKlons prior to 
HB 2020 and subsequent to HB 2020. Qenerally, coliaboratlon has Increased; however, not too 
surprisingly, the area where high school faculty members sense the least amount of collaboration 
is in the area of collaborative cunlculum planning. 

A similar pattern of responses emerged when faculty members were asked about specific eftects of 
HB 2020 on teacher colleglality. More elementary teachers lndk»ted progress In that 'f?a in both 
the Fail and Spring (67 percent; 78 percent) than mkidle school/junior high (62 percent; 
64 percent) or high school faculty members (56 percent; 62 percent). 
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In sum, collaboration on Issues broader than school Improvennent projects Is taking place and Is, 
according to faculty members attributable to practices set In place by the requirements of the 
legislation. However, the well-Institutionalized norms, values, and beliefs held by different 
occupational communities necessitates that change be conducted differently and that 
expectations for changes in practices and processes be consistent whh the way schools operate. 



Decision-making Opportunities 

in addition to a change In the working relatkxishlps ol faculty members resulting from the 
implementatton of HB 2020, there Is evMence that deciskxi-nuiking opportunities at the school 
level have increased as the result of the legWatton. This chan^ j Is an expected outgrowth of the 
restructuring of the workplace in that changes In the decision structure of schools should result in 
faculty members having greater opportunities for making declstons that affect their work. While 
cotiaboration refers to people working together In a joint effort of one kind or another, one cannot 
automatically assume that an outcome of collaboratkm wilt be an increase in influence over 
decisions. Collaboratlon may enhance a group's ability to marshaii support to effect a 
decision - especially If there is consensus among group members on the issue at hand ~ but It 
Is not equal to influence in decision making. Hence It becomes important to know If faculty 
members perceive that as a result of the restructuring of the workplace they have also gained 
authority to make decisions that affect their worlc. EvMence for this will then suggest that changes 
In the authority structure at the school level have produced an environment that fosters 
occupational governance. Having opportunity to collaborate and influence decisions on nnatters 
that are consMered Important and critical to one's work are evklence of movement toward 
occupational self-control. 

When faculty members were asked If prior to HB 2020 teachers had enough opportunity to 
Influence decisions thai effected their work, fewer than half the total respondents (43 percent) 
answered in the afflmnatlve. However, with the ImplementatkMi of HB 2020 came a change in the 
wori<piace and not surprisingly, a change in respondents' sentiment. A dear majority of 
respondents (65 percent) indk»ted that they agreed or strongly agreed that teachers had enough 
opportunity to Influence decisk>ns that affected their wort(. This plurality of sentiment has been 
maintained over the school year with 64 percent agreeing that they had opportunities to influence 
decisions that affect their wort(. 

These findings are corroborated in a questton that appeared In a later section of the fall and spring 
surveys where faculty members were queried about the anxxjnt of progress that had occurred in 
the area of teacher influence In deciskxi making that was directly or indirectly attributable to 
HB 2020. The percentage of respondents who indicated there had been a lot or moderate 
progress in this area (64 percent) Is almost kJentlcal to the percentage of respondents answering 
In the affirmative to the earlier questkxi. Clearty, respondents perceive that Implementation of 
HB 2020 has had a positive impact on Influence In decisk)n making. 

However, decision opportunities ure rarely the same for all indlvkJuals in a school. Organizational 
size, school level, staff position, and membership on decision-making committees can, and often 
do, mitigate decision opportunities for faculty members. 

Effect of District Size, ^'hen data regarding the opportunity to influence decisions were 
reanalyzed by district size, a relationship between organizational size and deciskNi opportunity 
emerged. More faculty members In small districts Indteated they had enough opportunity to 
Influence decisions than dkl faculty members In very large districts (see Table 11). Although the 
differences are not great they are substantiated by Interview data. Teachers woridng in small 
districts Indtoated that they had a relatively easy time Influencing decisions because there was 
virtually no hierarchical chain of command that had to be followed or consulted. They felt they 
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were in charge and autonomous In n>08t decisions affecting their work. Interviews with 
administrators in the small districts confirmed teachers perceptions. By way of contrast, teachers 
in very large districts felt constrained in their decision malting efforts (because district protocol 
required that they confer with individuals at several levels tMfore a final decision could be iTiade. 
Teachers idc itlfied school policy as an area In particular that required a final decision to be made 
by district administrators. Being able to determine grading pollciee. attendance policies, staffing, 
and scheduling (e.g.. detemnlning length of school day) were cited as examples of policy decisions 
that teachers felt constrained to make. This was true for personnel In all schools in a large district. 
A large district with a decentraiized decision structure did appear, however, to offer a modicum of 
decision latitude not present In more centralized districts. Although there were district level 
policies developed and enforced by district administrators in both kinds of districts, teachers and 
administrators in the large decentralized districts felt slightly nfK>re in control of what went on In 
their school than did teachers and adminisiators in large centralized districts. 



Table 11. 

Opportunity to Influence Decisions 
by District Slze^ 



District size 


Pre HB 2020 


Fall 1988 


Spring 1989 


< 1,000 ADM 


41 % 


69 % 


71 % 


1.000-4,000 ADM 


46 


64 


63 


4.000-10,000 ADM 


41 


65 


64 


> 10.000 ADM 


38 


58 


60 



1 01 : #10 and 11 ; 02: #5. 'Strongly Agra*' and 'Agra*' ratpontaa oomblnad for aach point In tima. 



Effect of School Level. School level was also found to relate to opportunity to influence decisions 
(see Table 12). Elementary schools are comprised of a more homogeneous faculty than either 
mkldle schools/Junior high schools or secondary schools. As an occupational community, 
elementary teachers have more simiiar educattonal backgrounds and share similar beliefs and 
values about the way their school Is to operate. Elementary teachers generally have a classroom 
of students for an entire year and are responsible for making and enforcing pdtoy decisions that 
affect classroom life (e.g.. discipline, grading). Elementary school faculties have been likened to a 
large fiimHy and the appropriateness of this metaphor was reinforced during interviews when 
teachers used the pronoun W to describe how declskms were made and who was involved. 
Elementary principals tended to wori< with their faculty to make school level declskms together. 
Thus, there was litter change in elementary school staff In the perceived opportunity to influence 
decisions from 'Before' to 'After* SIPD. 

District size and degree of centralization mitigates this practk:e by reducing the number of decision 
domains avaHable to a faculty. A principal of a small elementary school In a very large centralized 
district explained that the amount of authority she had was constrained by deciskxis made by 
central offtee admlnlstratkKi. She nad limited resources and decisions made at the school level 
were really Just adaptations of district policy. Nevertheless, she included her teachers in all school 
level decisions that would impact their worf( lives. 
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This practice was less likely to occur in middle schools/Junior high schools or secondary schools 
for reasons of size, complexity, and diversity among faculty. Middle schools/|unior high schools 
and secondary schools are, most of the t.me, structurally differentiated in the sense that teachers 
are trained as subject matter specialists and classes generally are organized around speciflc 
sisbject matter. Diverse occupational communities comprised of individuals with different 
backgrourvds, beliefs, values, and work norms have difficulty coming together and making 
schoolwkle decisk)ns. Large size complteates the problem and makes opportunity to make 
decisions less likely to occur. Nonetheless, perceived opportunity to influence decisions increased 
in both intermediate and secondary schools from "Before" to "After" SiPD (see Table 12). 

Table 12. 
Opportunity to Influence Deelsions 
by School Lever 





Pre HB 2020 


Fall 1988 


Spring 1989 


Elementary 


68 % 


65 % 


66 % 


Intemiediate 


50 


72 


66 


Secondary 


39 


59 


58 



1 01 : # 10. 11 ; 02: #S. P«rMnt raipondlng 'StroflQly Agr**' and "AgrM* ar* oomblnad for aach point in tima. 



Effect of Site Committee Membership. Opportunities for decision influence and change in 
nature and extent of decision Influence as a result of HB 2020 were also found to be different for 
site committee members and non site committee members. Site committees are the groups of 
individuals in each school who in effect manage their schools' SiPO projects. Site committee 
members are responsible for, among other things, the fiscal management of SIPD funds, the 
implementatton of project goals, and they have decision making power over various parts of their 
projects. 

As a governing body, site committees are in a propltk)us positk}n to effect change at the school 
level. They have been selected by tlieir peers and thus have, for the most part, the trust and 
confidence of these individuals when It comes to making deciskm In most of the schools visited, 
site committee members made a lot of the initial or primary decisions concerning their school's 
SiPD project This v/as particularly the case for detemiining professtonal development activities. 
Goal development was orchestrated by site committee members at the application stage, 
implementation of SiPD projects and evaluation of goal attainment were also organized by site 
committee members. Faculty members were involved in the decisk)ns but were not often 
instrumental in the early stages of the decision process. Staff seemed content and satisfied with 
the role that site committee members had assumed; they were not perceived as autocratic. 
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In sum, as an organizational artifact ot the legislation, site committees assumed a leadership role 
that crossed traditional boundaries of decision responsibility. According to site committee 
interviewees, resource acquisition and authority to make decisions concerning allocation were 
critical components of this new role. For the first time a committee of teachers and administrators 
shared fiscal responsibility for managing a schooiwide project developed by members of the 
faculty. This included maldng critical decisions about the implementation of ail facets of the 
project. Hence, armed with new responsibilities and Iniluence. It Is not surprising that site 
committee members perceived decisloii opportunities differently than their non-site committee 
colleagues. And. also not surprisingly, they attributed these opportunities to HB 2020 (see 
Tables 13 and 14). 



Tabit 13. 

Opportunity to Influence Declsloiis 
by Site Committee Memberships 



Pre HB 2020 FalM988 Spring 1989 



Site Committee 46 75 77 

Non-Site Committee 40 59 68 



1 01: #10, 11; 02: #5. P«rc«nt rtipondlng 'Strongly AgrM* and 'Agr*** v oombln«d for oach point In timo. 



Table 14. 

Change in Teacher Decision-Making influence 
by Site Committee Membership^ 



Fall 1988 spring 1989 



Site Committee 75 81 

Non-site Committee 58 58 



1 01 : # 105; 02: #37. Ptrcant rotponding 'Modorat* Progr«M' and ' A lot of Prograis' ara oomblnad for aach 
point In tima. 



SiPD Final Report 



48 



NWREL October 1989 



Efftct Of Staff Position. Differences In perceptions about decision Influence were also found to be 
related to school position. When survey data were reanalyzed by position, a larger percentage of 
administrators than teachers felt that teachers have enough opportunity to Influence decisions (see 
Table 15). This finding was not surprising because K corroborated administrators perceptions of 
teacher decision Influence discussed during Interviews. The likely origin of this difference is 
confusion about the difference between decision involvemem and decision influence that arose 
during interviews. Principals refenred to teacher Involvement on various committees when they 
spoi(e of how teachers were able to influence decisions. Teachers, however, commented that they 
may be Involved In decision maldng but not influential in the outcome. 

When the finding is considered in the context of HB 2020 and the restructuring of the worl(place, it 
tal(es on special Importance because It speai(s to Individuals worldng together with widely differing 
perceptions of what is considered enough decision influence for teachers. This Issue is central to 
the success of a she-based management program and lli(ely holds tha key for ensuring teachers' 
occupational self-govemance. Differences in perception about what constitutes enough 
opportunity for teachers to influence decisions are an example of role conflict between teachers 
and administrators that Is the result of Incongruent expectations about the role of teachers. 
Teachers and administrators definition of a situation is going to be different if perceptions about 
roles are Incompatible. Role conflict has the potential for undenfnining the success of a site-based 
management program because differences here reflect dissension in beliefs anrrang administrators 
and teachers about the nature and extent of occupational control teachers should have over 
critical wori(-reiated decisions. 



Table 15. 
Opportunity to Influence Decisions 
by Staff Position^ 

Pre HB 2020 Fail 1988 Spring 1989 

Teachers 40 62 62 

Administrators 67 93 91 

1 Q1 : # 10, 11 ; 02; #S. P«rc«nt rtapondino 'Strongly AgrM' and 'Agrtt' arc oombintd for each point in tima. 



Summary of Decision-Making Opportunities, in conclusion, opportunKles for teachers to 
influence decisions that affect their work have increased as a result of HB 2020, particularly In 
areas integral to the implementation of SiPD projects. For some faculty members however, 
opportunity has been greater than for others; when differences occur, they are related to certain 
features of the school organization. Specifically, distrtet size, school level, site committee 
membership, and school position were found to be related to differences in perceived decision 
opportunities for teachers. 
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The fact that certain oroanizational characteristics may temper the effects of HB 2020 Is Important 
for understanding the kinds of expectations one can have regarding the Implementation of school 
improvement pri^ects, especially projects that are Intended to alter extant decision structures. 
Schools as Implementing organizations are established social systems with already patterned 
behaviors. Consequently, change In social structures and behavior Is not going to be uniform 
across school organizations nor is the process ol change going to be the same for all types of 
schools. Indeed, what was found during site visits was that change Is intricately tied to a school's 
larger Institutional setting. What happens Is that the legislation affects Implementation by 
interacting with organizational characteristics to produce different situational constraints and 
opportunities for faculty members. This was especially true In the case of declsion-mal<ing 
opportunities for teachers where the interactive effects of legislation and school context had 
bearing on the amount of opportunity teachers have to influence decisions that affect their vi ork. 
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Professional Growth and Development 



Professional development activities were a major part of the total project effort. Tfiese consisted of 
both group activities and mlnl^rant actMtles. These two categories were not entirely separate and 
often were mutually supportive. Types of professional development activities Included wori<shops. 
university and college couwes, visltatlona to other schools and programs, conferences, teacher 
presentations, and staff retreats. Faculty members In all 70 SIPD schools were queried about the 
nature and extent of professional development opportunities and activities prior to and subsequent 
to the Implementation of their project. Attention also was given to this Important feature of the 
legislation during interviews when the contour of each project was explored with selected faculty 
members In 25 schools. 

Changes In Teacher Involvement In Professional Development Activities 

The Fall questionnaire asked six questions regarding professional developrrrr>\ <^ctlvltles and five 
of these questions were repeated In the spring. Table 16 showvs the descriptive statistics for each 
item before the SIPD project. In the Fall of 1988, and In the Spring of 1989. There are large 
increases from "Before SIPD" to "Fall 1988" In the percent of staff who agree with each of the 
statements, but there Is little or no change from "Fall 1988" to "Spring 1989" In the percent of staff 
who agree with these statements. The magnitude of the change from prior to SIPD to Fall of 1988 
is expected because of the emphasis in the legislation on professional development activities. A 
major thmst of each SIPD project was development and Impiementatlon of professional 
development activities. Professional development activities were designed to take place over the 
course of the school year; data reflect that teacher Involvement has been sustained throughout 
this period of time. Total group responses to the Items In Table 16 are graphed in Figures 31 
through 36. 

Professional growth and career opportunities were part of the school-based management stnicture 
at each of the schools In the sense that control over this decision area rested with site committees 
and often the entire faculty at a school. As such, professional development activities became a 
prominent feature of every SIPD school. Indeed, at some schools professtonal development 
activities were the vehk:le(s) for Implementing SIPD goals or v/ere the goals themselves. 

During Interviews, faculty members were asked about changes In deciston making opportunitli s 
since the impiementatlon of HB 2020 and neariy all individuals concurred that opportunities had 
increased, partteulariy In areas related to xh^U SIPD project Specifically, Interviewees Identified 
professional development activities as the area where they had the greatest amount of decision 
influence. Given that the majority of SIPD resources were allocated to this area It Is not surprising 
that teachers felt they had Influence In deckling how money was to be spent on staff development. 

For teachers, professkNial development actMtles are their life-blood; they are a life buoy, they 
recharge, and they often provkle the Inspiration to persevere In the face of adversity. Hence, their 
Importance for teachers as a decision domain cannot be understated. Inten/lewees spoke 
overwhelmingly of being able to make decisions in this area as central to who they were as 
professionals. This expressk>n of satisfaction was relat%^. In their minds, with the amount of 
control they felt they now had In determining how professional development resources were to be 
allocated. Teachers In particular noted that being able to deckle how to enhance one's role as an 
educator was an Important source of power and control cf -a one's wori<. For most Interviewees, 
prior to HB 2020, authority over this Important decision c ? < <Aln had beon out of their hands. Not 
surprisingly, change In this area has had significant consequences for toachers; however, as a 
matter of Importance, the change Is related directly to the larger Issue of school finance. 
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Tabl« 16. 
Professional Growth Activities 



Item BtfortSIPD Fall 198S Spring 1989 

Mmo S.D. M«an S.D. Mtan S.D. 



Ongoing program of 
staff development 

based on needs 2.82 1.02 1.99 .94 - - 

Teachers encouraged 
to become Involved In staff 

development activities 2.44 .94 1.66 .76 1.66 .74 

Teachers seei< better 

ways of teaching/learning 2.17 .77 1.71 .68 1.71 .68 

Teachers have time to 
examine research before 

solving school problems 3.29 .94 2.84 1.03 2.85 1.01 
Teachers frequently share 

ideas wKh each other 2.30 .93 1.86 .83 1.86 .85 

Teachers are given time to 
solve problems facing the 

school 3.25 .94 2.70 1.04 2.76 1.07 



Kty 

1 • Strongly AgrM 

2- AorM 

3- Uno«rUin 

4 • Diugrt* 

5 • Strongly DItagrtt 
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Figure 31. There Is an ongoing program of staff development based on established needs. 
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Figure 32. Teachers are encouraged to become Involved In staff development activities. 
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Figure 33. Teachers in this school seek better ways of teaching and ieaming. 
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Figure 34> Teachers are given time to examine research to solve school prot>lems. 
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Figure 35. Teachers frequently share ideas wii h each other/ 
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Figure 38. Teachers are given time to solve problems facing the school. 



ERIC 



SIPD Final Report 



55 



NWREL Octot)er1989 



65 



The economic environment In which a great many of the SIPD schools operate has been, 
according to Inten/lewees, stable but poor. Many of the schools visited are in the safety net. 
Financial Instability has translated into a retrenching of funding In certain educational areas. Most 
notable of the areas cut for teachers has been staff development. Over time, as staff development 
funds have been curtailed and eamtarked for other educational areas, districts have responded to 
staff development needs by providing only districtwide activities. This common denominator 
approach has resulted In teachers feeling that their professional growth neecfs are not being 
satisfied. For many, the inservlce activities made avaiable by the district sii nply did not make a 
difference to them professionally; that is, either they were not tailored to the specific needs of the 
audience (an Impossible task when the audience Is all the teachers In a district) or they did not 
enhance teachers professkMial development as educators (also an impossible task when an 
audience Is so diverse In background). Consequently, according to Interviewees, teachers often 
passively resisted their districts attempts to provkie meaningful staff development activities by 
attending but not actively participating. This practice changed with the Implementation of 
HB 2020. 

According to Interviewees, for the first time In most of their professional lives they had control over 
decisions about how best to enhance their role as educators. Without question, the ability to 
deckJe how to allocate resources - lots of resources ~ to this area changed the lives of teachers 
more than any other aspect of the legislation. Teachers became effusive when they described the 
activities (hey had chosen for their school and for themselves. For the majority of SIPD schools, 
professional development training In particular areas was the vehicle for reaching specific project 
goals. For example. In several schools a goal was to develop a cooperative learning environment 
for students and faculty. This was achieved Initially by provkJIng cooperative learning workshops 
for teachers. The fact that faculty members deckled both on the actual goal and how to reach the 
goal made teachers feel that they were In charge of their professk>nal lives. In some schools, 
professional development activities were the actual goals themselves. And In schools that opted to 
Include minl-srants as part their SIPD projec'., teaci>ers were able to select activities that were 
unique to their grant's goals. The anwunt of latitude} teachers had In selecting professksnal 
development activities was Infinite In the sense that control over the declskxis rested with them. 
Only In very few circumstances where some teache -s attenr.pted to use funds for activities that 
were not congruent with district and community norms were teachers limited or restricted In their 
choice of activities. 



Clianges in Who Influences Professional 
Development Activities 

FaciAy members were asked In thn fail and spring surveys and In interviews about their decisions 
regarding professional development activities (e.g., the nature and e)(tent of their decision 
Involvement and Influence), whether profe8sk)nal dtrvelopment opportunities had changed much 
since the Implementatton of HB 2020. and what the effects of any change had been. According to 
interviewees, teachers have been actively seeking new Informatkm about teaching and learning 
through participatk)n In professkMial development activities (e.g., workshops, conferences, 
courses) and they have been encouraged by site committee members throughout the year to 
become Involved In the staff development program established in their school. Importantly, the 
programs In each SIPD school have been designed based on a needs assessment of the faculty. 
Faculty members' views were solicited at the time declsk)ns were made about how to reach project 
goals through staff development actMtiet. According to many interviewees, this 
practice - Mentifying needs through an assessment, relating activities to project goals, and 
provMIng a variety of activities to meet or satisfy the goals - is different from the way their districts 
have operated In the past with respect to detennlning and provMIng staff development 
opportunities. As shown In Figures 37 and 38, survey data corroborated this inten/iew finding. 
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Effects of Professional Development ActWitles 



Two items on the Fall survey that aiso appeared on the Spring survey iskod respondents to note 
the amount of progress that had been made in areas that were Integral to their SIPD project. As 
Figures 39 and 40 Indicate, over half the respondents felt that a moderate to a lot of progress had 
been made In the area of professional development In the fall. By spring, an even larger 
percentage of respondents felt the positive effects of HB 2020 on professional development 
opponunltles and activities. In a corresponding manner, the percentage of respondents who felt 
there had been slight or no progress In these areas decreased over the course of the school year. 

Figures 41 . 42 and 43 provide a breal< iown of responses for different organizational characteristics 
found to mitigate the effects of legislhron Implemented on a schoolwide basis. As Figure 41 
illustrates, a greater percentage of elementary than middle/junior high school and secondary 
teachers felt progress In this area, as did more administrators than teachers (Figure 42) and more 
site committee members than non-site committee members (Figure 43). 

The Impact of resource allocation on professlt/nai development opportunities has been felt by 
almost everyone In each of the schools, interviewees In alt the schools visited were able to carry 
on conversations about their schools professional development activities and the benefits they had 
derived from participating In wort(Shops and attending conferences suggesting that this particular 
feature of the legislation had reached nearly everyone In each of the schools. According to 
teachers at all levels, the professional development activities that provided new information and 
knowledge about teaching strategies, a new language for teachers to communicate with one 
another, and that encouraged teacher Interaction and dialog about the newly acquired learning 
were the most helpful and the most utilized. The ability of the trainer to concretize concepts (e.g.. 
how to use cooperative learning in American Uterature classes) also enabled teachers to 
immediately apply what they had learned. This was particularly true for high school teachers. 
Hence, regardless of a schooTs specific project goals, professional development activities that 
could be readily transported Into the classroom were, according to Interviewees at all levels, the 
nnost appreciated. Teachers In SIPD schools where attaining project goals rec^uired learning a new 
language were also In the propitious position to then be able to communicate across grade levels 
or subject areas. For examplb, an elementary school had as one cf Its goals "writing across the 
curriculum" and hired two consultants to provide training In this area. During Interviews with 
faculty members at this school. Individuals emphasized how primary teachers were now able to 
tall< with intennedlate teachers about designing a writing curriculum that included a progression of 
sl<iils to be taught at each grade In different subject areas and how to assess students writing 
ability on an ongoing basis. A first grade teacher referred to a discussion she had had with a fifth 
grade teecher about Implementing a writing project and noted that this kind of conversation would 
not and coukl not have been possible without the training the faculty had received. This kind of 
"whole faculty professkxial development training" In an area was more comnKMi In elementary 
schools and often resulted in elementary teachers speaking the same language. This enhanced 
their opportunity to work together on a wMe variety of school Issues, not just those related to 
specific project goals. 
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Dm^ranoet In Profotsional Development 
Across School Levels 



Professional development activities In middle school/Junior high school and secondary faculties 
were simitar In type (e.g., workshops, conferences, courses) to those offered In elementary schools 
but because of school organization size and complexity, the way in which professional 
development activities were made avaRable to middle/Junior high school and secondary school 
faculties was different. If offered to the entire faculty, training had to be broadly based and thus 
more generic in nature, or teachers were grouped and received training by specialty area or 
teachers selected what they wished to attend and did so as individuals or In small groups. The 
outcome generally was not the same as for elementary schools In terms of professional 
development having a schoolwide effect; however, middle school/Junior high school and 
secondary school faculty voiced the same reaction as elementary faculty members to professional 
development activities they had participated In; each Interviewee was ebullient about the new sidlls 
and l(nowledge she/he had acquired. 

More often than not, middle school/junior high school and secondary school Interviewees spoke 
of the Individual professional benefits they had derived from participating In professional 
development activities. The nature of their professional training as subject matter specialists 
centers their attention more on their department and what they teach than on schoolwkJe issues . 
iHence It was not uncommon to talk with excited intemiediate and secondary teachers about 
conferences they had attended in their discipline and workshops they had participated in in their 
discipline. When groups of teachers were able to attend a regtonal or national meeting of their 
discipline (e g., Nattonai Association for Teachers of English) they would come back to their school 
with a sense of renewal and enthusiasm for teaching, The tact that several teachers in a 
department were able to attend the same conference enabled teachers to collaborate on 
currtouium issues and the like. 

Conversely, when schooivi/lde training in a particular area was provMed Its utOity was limited 
because teachers sakJ they dkl not often see its immediate application to the subject matter they 
taught or to their classrooms of students. This suggests that the use of schoolwide professional 
development activities to reach project goals in mkidie schools/junior high schools and secondary 
schools needs to begin small, i.e., within departments or grade level dusters, and gradually move 
outward to include a larger assemblage of individuals. When working with a diverse population, 
efforts to inculcate a new set of beliefs, values, and nomis must be seen as viable by the 
indlvMuals in each occupational community before an attempt can be made to make systemwkie 
changes. Simply put, the variability that characterizes the Oi'ganizatkMi and operation of mkidie 
schools/junk}r high schools and secondary schools needs to be honored and respected when 
staff development activities are being planned. Systemwkie change is likely to occur If it is 
preceded by sub-system change. According to teachers, a key to tacNitating this is through the 
availability of professional development activities that have a rMdy appllcatkxi to the subject 
matter being taught. Hence, If a schoolwkle goal is to establish a cooperative learning 
environment, training in cooperative learning that is subject-matter based Is likely to be more 
effective in mkklie/juntor high schools and secondary schools than schoolwkle inseivice training 
in this area, laming the new tanguage of cooperative learning in one's native tongue has direct 
utility whereas learning a generic language apparently does not. 
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Figure 37. Responsibility for detennining which professional developnrant activities. 
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Figure 38. Responsibility for determining who participates In professional development. 
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Figurt 39. Change In teacher akiils and strategies. 
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Figure 40. Change In professional development opportunKies. 
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Figure 41. Change In teacher skills and strategies by grade level. 
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Figure 42. Change in teacher skills and strategies by school posKlon. 
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Figure 43. Change In teacher sIcHis and strategies by site connniittee meml^ership. 



Faculty members were aslced on the spring survey if their schooTs HB 2020 project had resulted in 
faculty now speaking the same language. Responding in the affirmative would indicate, among 
other things, that one of the effects of professional development activities had been acquisition of a 
comnfK>n or shared language that could be used to discuss arxl implement components of their 
project. Speal<ing the same language also augurs well for consensus building in schools since 
collecttve opinion and agreement rest on Individuals being able to communicate with one another 
using the same vocabulary. Less than half the respondents surveyed (42 percent) responded in 
the affirmative to the question. However, when data were reanalyzed by school level more 
elementary (54 percent) than either middle school/junior high school (31 percent) or secondary 
school teachers (32 percent) answered that their faculty now speaks the same language. As well, 
more administrators (64 percent) than teachers (42 percent) and more site committee members 
(60 percent) than non-site committee members (36 percent) answered In the affirmative. 

These findings are not surprising given the nature of professional development training in 
elementary schools discussed earlier and the wett-documented perceptual differences between 
organizational members holding different posittons with different rde responsibilities and assigned 
tasks (e.g., teacher/administrators; site committee members/non-slte committee members) The 
importance of the findings lies in knowing the kind of outcome we can expect or hope for from 
professional development training at the end of the first year of a school improvement project at 
each of the school leveli. Elementary schools are apt to see a change In practices much sooner 
than either mMdIe schools/junior high schools or secondary schools because of issues related to 
school size and relative lack of complexity and diversity (In terms of school organization and 
presen/ice training of teachers). Conversely, change is going to be slower for middle 
schools/junior high schools and secondary schools. 
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In conclusion, the avallabltlty of professional development activities at all levels at a time when 
most districts have had to curtail staff development efforts was reported by Interviewees to have 
been the most significant feature of their HB 2020 project. The opportunity to participate in a 
variety of workshops and conferences and to acquire new knowtedge and information about 
teaching and learning enhanced teachers sense of themselves as professional educators. 
Although opportunity was predicated on there being available resources, it was the decisions 
teachers made about professtonal development ai;(lvitles that made the opportunities so 
worthwhtte. This point Is significant because it captures the essence of slte>based manegement. 
Resources created opportunities that enabled teachers to make decistons about their professional 
lives. 



Mini-grants 

in addKlon to activities that wore part of each schooTs general professional development program. 
SiPD schools could, if they elected to do so, design and administer a mini-grant program for 
eligible faculty members. The mlnl«grant program afforded IndMduals in a school an opportunity 
to pursue an independent activity or project that they were interested in but had not heretofore had 
the resources to engage in or accomplish. Responsibility for the development and management of 
a schooTs mini-grant program rested with school site committees. This Included establishing 
criteria for applying for grants, publteizing or advertising the availability of grants, selecting 
grantees, monitoring grant projects, and overseeing the fiscal management of the mini-grant 
program (see Figures 44 and 45). 
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Figure 44. Responsibility for determining whteh professh}nal opportunities to offer. 
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Figure 45. Responsibility for criteria to determine eligibility for professional mini-grants. 



Individuals interested in applying for mini-grants were responsible for developing a proposal that 
discussed what project or activity they wished to pursue and Its relationship to the schools SiPD 
project, what goals they were trying to reach and the means for assessing their attainment, and 
how they intended to use the resources (e.g.. for curriculums development, to attend 
conferences, etc.). The mini-grant program was avaHabie to all faculty members and in most 
schools there was no limit on the number of grants one could apply for. Grants generally were in 
the range of $S00-$1 ,000. At some schools, workshops were conducted to help individuals 
prepare proposals. While there were certain legislative requirements for awarding grants that were 
the same for ail SIPD schools, e.g.. demonstrating the relationship between mini-grants and a 
school's SIPD project goals, schools, specifically site committees, had latitude In taloring grant 
requirements to further the professional development of all school personnel. This generally was 
accomplished through a provision in a schooTs grant application that stipulated that grantees were 
required to write a short paper about thel^ activity or project to be dIssenUnated to all taculty 
members or to present at a fuculty or special Interest group meeting their project results or what 
knowledge or new Information they had acquired as a result of pursuing an activity. 

The majority of mini-grants v^ ere awarded to IndlvMuals Interested In acquiring new teaching 
strategies and knowledge through partlcipatkHi in workshops and conferences. When 
Interviewees were asked about goals they hoped to reach through their mini-grant, respondents at 
ail levels cited personal professional goals related to teaching and learning, speclflcalty, to Increase 
their knowledge and expertise about teaching and learning and to be able to exchange and share 
kJeas with other professionals. For many respondents, there seemed to be a blurred distinction 
between grant goais and personal professk)nal needs. Having the opportunity to select and attend 
conferences and workshops and to pursue projects of their own choosing were kientif;<id as the 
most satisfying aspects of receiving a mini-grant. In tenns of assessing whether their goals were 
being reached. nf)o$t interviewees returned to their discussion of the activities they were involved in 
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and talked about the ru^w ways they organized their classrooma for Instruction, how they employed 
new methods for worldng with certain idnds of students, how they had developed new curriculum 
materials, and the llite. Many did not equate these outconws with goal attainment; rather, they 
referred to them as the way they utilized the information gained fi'om their grant experience. For 
interviewees, being able to assess goal attainment was not as important as being able to 
demonstrate - during the Inten/iew - how they used what they had learned and the difference it 
made in what they were able to do In their classrooms. The fact that their classroom dlmate had 
improved, or student learning had increased, or their teaching repertoire had been expanded was 
what mattered to grantees. 

There are many similarities between the Idnds of activities associated with mini-grants and those 
associated with a schooTs general professional development program. In many respects 
mini-grants were a microcosm of a schooTs general professional development program. For 
example, workshops and conferences In parttoUUir were selected most often by faculty members 
for both kinds of professi'Vttl development activities. This occurred because staff development 
opportunities had been curtailed In most districts and teachers were hungry for new Infonnatlon 
about teaching and teaming, and because workshops and conferences in their field(s) of Interest 
are often the most appropriate venue for this to occur. These kinds of activities also offer an 
opportunity for professionals to exchange and share Meas with other professionals. The major 
difference that distinguishes mini-grants from a schooTs general professional development 
program is that with mini-grants IndivMuais could design a project tailored to their specific needs 
and Interests. Although the mini-grant project had to relate to the schooTs SIPD project goals, it 
afforded IndivMuals an opportunity to pursue a special Interest 

For faculty members, having the addKkmal resources to pursue a special Interest made the 
mini-grant worth coveting. The fact that Intenriewees spoke of their 'mini-grant experience' In 
much the same vein as Inten/lewees had discussed their schooTs professkMial development 
activities speaks to the wishes of IndMdual school personnel (as opposed to district 
admlnlstratore) being reflected in the schooTs professkxial developrnent program. According to all 
Intenriewees, having a votes In determining how resources were to be allocated In an area central 
to their professional lives made an enonfnous difference In their perceptions of who they were and 
what they were able to accomplish as educators. 
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6. RESULTS AND DISCUSSION: 
ACCOMPLISHMENT OF PROJECT GOALS 



in this sectlor we ^tte nnpt to answer the question To what extent did the projects reach the goais 
establishied In (heir applications?' To do this, we look to the fourth quarter reports, In which 
projects were aslced to submit outcome data. 

in reviewing the fourth quarter reports, we found that seven of thi^ '^0 projecfs did not submit 
reports at all. Of the 63 reports received, only 42 included any OL come data, in many cases, 
data were available and Included for some goals but not others. Student achievement data was 
often not yet available at the time the report was written. Of those Including data, only 34 had 
summarized or Interpreted the data In relation to project goals. Of this group, most met some of 
their goals, but only a handful provided evidence that they had met all of their goals. A typical 
pattern was to see Improvement in some attitude areas, or improvement In student achievement at 
some grade levels but not others. This does not suggest that SIPD projects were not successful, 
but rather that. In n^ny cases, the data were not available to answer the questions, or that goals 
were too numerous and too ambitious to be met in one school year. 

These findings from the quarterly reports suggest a number of different conclusions. First, It Is 
dear that project staff need more training and technical assistance in collecting, summarizing, and 
interpreting data to determine if project goals were met. Second, the tinne frame of the grant 
period was too short In many cases to expect dramatic Improvement in variables such as student 
attitudes and student achievement. Further, irwst schools who wanted to look at student 
achievement did not have their spring test scores back from their scoring service In time to Include 
them in the fourth quarter report. Those who did have student achievement data typically fdund 
improvement in some areas or grade levels but not others. It Is probably too much to expect that 
inservlce training In a new teaching strategy such as cooperative learning will produce dramatic 
changes in student achievement in a few short months. Finally, if this evaluation question Is 
important, more emphasis should be placed on evaluation activities as part of SiPD grants. 



Role of the Site Committees 

The Site Committees were the key to meeting project goals. As we wBI see in Chapter 7, one of 
the key predictors of project outconr«es and project success was site committee leadership. As we 
saw previously In Table 8, staff tended to agree that the site committee was a catalyst for 
meaningful change In the school; the site committee had a dear viskm of how to Improve the 
school; the site committee shared information effectively with the school faculty; and the site 
committee represented the Interests of the entire school taculty In its declskxi making. 

More than 600 persons statewkie served on site committees. The average site committee had 
approximately nine membera. Site committees were composed of 66 percent teachers, 
14 percent administrators, 1 1 percent parents and community membere, with the renrtaining 
membera specialists or counselora. 

The SIPD site committees had responslbllty for several Important aspects of schod Improvement. 
These Included gathering data on needs, Interpreting needs, making specifk: declstons, 
establishing goals, setting criteria, designing activities, allocating resources, gathering data on 
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progress, determining professional development programs and who Is eligible for them, evaluating 
programs, and determln'ng If goals have been met. Taken together, the data present a picture of 
most SIPD site committees being truly empowered to carry out the most Important aspects of their 
school improvement projects. 

Several questions were added to both the Fail and Spring questionnaires for the site committee 
members to answer. These questions pertained to the frequency of site committee meetings and 
site committee activities. Table 1 7 shows the frequency of site committee meetings during each 
quarter of the project. Except for the summer, committees were most iil(ely to meet twice a month. 
Over a fourth of them met at least once a week, and slightly less than a fourth met only once a 
month. Most dkJ not meet frequently during the summer. 

Table 18 displays the site committee responsibilities as reported on the Fail questk)nnaire. At least 
two-thirds of the respondents felt these areas were solely or mostly the responsibility of the site 
committee, except for 'establishing school improvement goals," where only 52 percent of the site 
committee members took sole or nwst of the respokisibflity. 

Figures 46 to 49 show the site committee responses to questions on the Spring questionnaire. At 
least three-fourths of the respondents agreed that they had well-defined processes In place to 
monitor the Implementation of changes associated with the SIPD activities, and to assist staff with 
implementing the changes. 

Only 38 percent of the site committee members disagreed that the effects of the SIPD project 
would dissipate without continued external financial support (Figure 48). There seemed to be a 
fair amount of uncertainty (27 percent) over what would happen without continued funding. 
Figure 49 shows that the majority of projects had held some fonnai discussions about future plans 
for the project by April 1989, but a third of the projects had only discussed future plans informally 
or not at ail. 



i &b 6 17. 

Site ComtT^ittee Hoeting Frequency 

TIME PERIOD 

Percent Meeting: Summer 88 Fail 88 Wlmer89 Spring 89 



At Least Once Weekly 4 26 26 29 

Twice MontNy 17 46 46 44 

One. . ontNy 31 23 24 24 

V 9SS Than Once Monthly 48 5 4 3 
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Table 18. 
Site Committee Reeponsibiiities 
(Fail 1988 Survey) 

DEGREE OF SITE COMMITTEE RESPONSiBiUTY 
Ptrcf nt RMponding: 

Soltly Moitty Som« VtryUttlt Nona 



Collecting data on potential 

improvement needs 23 

Interpreting data on potential 

improvement needs 27 

Deciding specific areas wheie 

improvement is needed 16 

Establishing school improvement 

goals 16 

Determining criteria for school 
improvement goals 22 

Designing school improvement 

activities 19 

Allocating resources for school 
improvement actMt'38 43 

Gathering data to note progress 

toward reaching school Improvement 

goals 28 

Determining which professional 

development opportunities 

to offer 23 

Developing criteria for detenninlng 

ellglbHIty for individual teacher 

professional mini-grants 50 

Evaluating school improvement 

programs 20 

Determining if school improvement 

goals have been met 28 



52 
50 
44 
36 
46 
46 
35 
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44 

28 
48 
45 
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26 
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20 
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23 
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7 
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6 
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3 
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Figure 46. We had a well-defined process to monitor the implementation of changes for HB 2020. 
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Figure 47. We had a well-defined process to assist staff wtth actual change implementation. 
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Figure 48. WKhout continued external financial support, 2020 r>frects will dissipate. 



Formal discuss/plan -\ 
Some discuss/no plan 
Informal discussion 
No discussion 
Don't know 




— I 1 — 

20 40 
Percent of Responses 



60 



Figure 49. Future planning for project (as of Aprfl 1969). 
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7. RESULTS AND DISCUSSION: 
IMPROVEMENT OF STUDENT OUTCOMES 



Most of the 70 SIPD projects included Improvement of student achievement, attitudes, or 
behaviors as one of their project goals. However, as we saw in the previous section, student 
outcome data were not available at most of these sites, or It was premat 'e to expect results after 
only one year of project activities. However, three Items on the Fall and Spring questionnaires 
asked for staff opinions about progress in these areas. 

Table 19 shows the mean amount of progress that staff perceived had been made In student 
achievement, student attitudes, and stivient behaviors as of Fall 1968 and Spring 1989. At both 
time points, the averages fall between 'slight progress' and 'moderate progress.' with more 
progress seen by Spring than was seen In the Fall. Again, since not all projects had goals directly 
aimed at Improving student achievement, the overall perception of progress In student outcomes 
nuiy be diminished. Also, those projects that focused on curriculum development or staff training 
will not see the Impact on students immediately. The greatest increase in progress was seen in 
student achievement, followed by student attitudes and student behaviors. These changes are 
Illustrated in Figures 50 to 52. 



Table 19. 
Progress In Student Outcomes 





Fall 1988 


Spring 1989 


Item 


Mean 


S.D. 


Mean S.D. 


Student Achievement 


2.60 


.84 


2.26 .81 


Student Attitudet 


2.53 


.92 


2.32 .91 


Student Behavior 


2.74 


.93 


2.60 .91 



1 •Atotofprograu 

2 • Mocl«rtt« prograu 

3 • Slight progrtM 

4 • No progrcM 
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Figure 50. Progress in student outcomes: Student Attitudes. 
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Figure 51. Progress in student outcomes: Student Achievement. 
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Figure 52. Progress In student 'outcomes: Student Behavior. 
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8. RESULTS AND DISCUSSION: 
PROJECT CHARACTERISTICS AFFECTING OUTCOMES 



In order to answer the evaluation question. iA/hat aspects of project context, design, and 
Implementation affected prolect success?*. It Is necessary to have some reliat)le measure of 
project success. As we have seen In the previous sections, many projects did not have good 
outcome data available to them by tfie end of the school year. Many who did have Infornuitlon 
such as questionnaire data, attendance data, or mlnl-grant reports, were not able to summarize or 
Interpret the data In a way that deaily demonstrated the positive effects of the SIPD project. In 
order to have a measure of project success that could be looked at across projects, we turned to 
the Fall and Spring Questionnaires. 

Regression Analyses 

Table 22 In Appendix B lists the Hems on each questionnaire that were combined to forni each of 
the scales described below. We created two dependent variables. Project Outcomes and Project 
Success. We then looked at several Independent variables whk^h we labeled Goal Setting 
Processes, Professional Growth Activities, Site Collaboration, School Climate, Site Committee 
Leadership, Principal Leadership, and Personal Involvement In SIPD to see which of these 
characteristics of the school and the SIPD project accounted for project outcomes and project 
success. This analysis called for the use of multiple linear regression, with stepwise entry of the 
independent variables Into the equation. 

Project Outcomes. This scale consisted of the same 14 Herns on both the Fall and the Spring 
questionnaires. Each Hem began wHh the stem. 'Since Spring 1988, how much progress has 
there been to date In the following areas, as a direct or Indirect result of Implementing your 
HB 2020 project?' The 14 areas Included student outcomes such as behavior and achievement, 
staff outcomes such as professksnai development opportunHles and Influence in decision making, 
and parent Involvement. 

Project Success. This scale contained Hems found only on the Spring questionnaire, and 
included specific questions about the HB 2020 project such as: 

The 2020 project has caused me to ahange a great deal. 

The 2020 project has made a difference for students at ^Is schooL 

We have quality, practical resources with which to Implement our 2020 activities. 

Goal Setting Processes. These seven questions asked about goal setting activHIes at three 
points in time, which fomned three different scales. The Fall questionnaire asked respondents to 
rate Hems "before 2020' and at the 'present time." The Spring questionnaire also asked for ratings 
of goal setting activities at the 'present time.' Sample Hems include: 

Community Involvement Is sought In developing the schoors goals. 

Goals for school Improvement have the backing and commitment of nearly all teachers in 
this school. 

Goals for school Improvement directly Influence what goes on In this schooL 
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Proftttlonal Growth. These six herns asked about staff development activities at three points In 
time, forming three different scales for "Before 2020," "Fall 1988." and "Spring 1989." Sample items 
Include: 

There Is an ongoing program of staff development based on established needs. 

Teachers In this school seek better ways of teaching and learning. 

Teachers frequently share Ideas with each other. 

Site Collaboration. These six Items asked about collaboration between teachers and 
administrators at three points in time, forming three different scales for "Before 2020." "Fail 1988." 
and "Spring 1989." Sample Items include: 

Teachers and administrators work together on areas which are causing problems and 
concerns In tfre school. 

Collaborative curriculum planning takes place In tfi/s school. 

Teachers have enough opportunity to Influence decisions that affect their work. 

School Climate. These nine Items appear only on the Fail questionnaire and ask about conditions 
"Before 2020' and at the "Present Time." Sample Items include: 

There Is a feeling of warmth and friendliness In the atmosphere of this school. 

Teachers are enthusiastic about working with each other. 

When we have conflicts In this school, the result Is constructive, not destructive. 

Site Committee Leadership. These four Items appeared on both the Fall and Spring 
questionnaires. Examples include: 

The 2020 Site Committee Is a catalyst for meaningful change In this school. 

The 2020 Site Committee shares Information effectively with the school faculty. 

Principal Leadership. These seven Items appeared on both the Fall and Spring questionnaires. 
Examples Include: 

The principal communicates a clear vision of what the school should accomplish. 

The principal shows teachers how they can contribute to the schoots mission through 
their Instruction. 

The principal plays a strong leadership role In the process of change- nd Improvement. 
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Ptrtonal Involvtrntnt In 8IPD. Thme 1S Moms were aeked on both the Fall and Spring 
questionnaires, and attempted to measure how Influential and Involved Individuals were regarding 
the 2020 project. Items Included: 

h/fy Input Is reflected In how decisions concerning the 2020 prc/ecf are made. 

When I participate In the 2020 project, If eel! can Influence the future of this school. 

I feel reluctant to become Involved In the 2020 project (scale reversed). 

Categorical Varlab'ta. District size, school level, and staff position were also entered as 
predictors In the regression analysis. The regression analyses were performed separately for the 
Fail and Spring questionnaires. ResuPis for the prediction of Pro^ecf Outcomes are shown In 
latAe 20 for both the Fail and Spring questionnaires. The order in which the independent 
variables enter in to the regression equation Is an Indication of their Importance In predicting 
Project Outcomes. Generally, the first mree or four variables that enter Into the regression 
equation account for most of the variance. Because of the large sample sizes, small increments in 
the variance accounted for (R^) were statistically significant, but probably not of practical 
significance. 

The variables which accounted for over half of the variance in Project Outcomes in the Fail were 
Personal Involvement In SIPD, School Climate In the Fall 1988, Site Committee Leadership, and 
Goal Setting Processes In the Fall 1988. The variables which accounted for over 65% of the 
variance in Project Outcomes in the Spring were Goal Setting Processes In the Spring 1989, 
Personal Involvement In SIPD, Site Commlttae Leadership, and Principal Leadership. Thus, three 
out of the four most powerful predictor variables in the Fall and the Spring were the same 
variables. School Climate entered the equation second for the FaH questionnaire, but It was not 
measured In the Spring. Principal Leadership entered the equation fourth with the Spring 
questionnaire, and some of the Items were similar to thotie grouped under School Climate. In 
other words, there was a fair anfKXjnt of consistency In which characteristics contributed to 
successful Project Outcomes In both questionnaires. 

The Items comprising the variable Project Success were measured on the Spring questionnaire 
only. Table 21 shows the most important predictors of the success of the school Improvement 
projects were Site Committee Leadership, Personal Involvement In SIPD, and Professional Growth 
Activities In the Spring 1989. Goal Setting Processes In the Spring 1989, Principal Leadership, 
and School L were also statlsticaliy significant. In total, over 66 percent of the variance in 
Project Succes.. was accounted for by these variables. 



Open-Ended Questions from Fall Quostlonnaira 

The Fail questionnaire Induded three open-ended questions designed to shed light on the most 
and least successful features of the SIPD prpiect to date. The perceptions of successes eariy in 
the projects probably relate to successful project outcomes. Respondents were asked to respond 
to three questions: 

1 . So far, what features of your schooTs 2020 project are most successful or effective? 

2. So far, what features of your schooTs 2020 project are the least successful or effective? 

3. What changes. If any. would you make In your schooTs 2020 project? 
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Tabl« 20. 
Regretsion Analyses 
Predicting "Outcomes" 



Fall 19M Survfy 
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.70 




3, Site CommKtM Leadeiship 


.72 


52% 


4. Goal Smting- Fall 


73 


54% 


5. School Laval 


74 


54% 


6. School aimate Before SIPD 


.74 


55% 


7. Principal Leadersnip 


.74 


55% 


8. Professional Growth 


75 


56% 


9. Site Collaboration • Fall 


75 


56% 


10. Position 


.75 


56% 


11. District SIza 


.75 


56% 


Spring 1989 survey 


B 

n 


p2 

n 


1. Goal Setting • Spring 


.69 


48% 


2. Personal Involvement 


.78 


61% 


3. Sito Committee Leadership 


.80 


63% 


4. Principal Leadership 


.81 


65% 


5. Professional Growth - Spring 


.81 


66% 


6. School Level 


.82 


67% 


7. Site Coliatwratlon • Spring 


.82 


67% 



Table 21. 
Rearesslon Analysis 
Predicting "Project Success" 



spring i989 Survey R 



1. Site Committee Leadership .73 54% 

2. Personal involvement .78 61% 

3. Professional Growth • Spring .81 65% 

4. Goal Setting -Spring .81 66% 

5. Principal Leadership .81 66% 

6. School Level .81 66% 
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Any relevant comments, other than thota such as 'unknown' or too eaily to tetl' were considered 
valid, and the first three valid comments to each n<iestlon were coded. Nearly a third of the 
respondents gave no valid comments to any of the three questions. As tar as most successful 
features, professional development and mini-grant opportunities (39 percent), and prq|ec! 
outcomes (28 percent) were mentioned most frequently. Project outcomes Included such 
comments as 'student attendance seems to be up' and the creation of a new attendance policy 
has been very Important.' 

Staff also valued the by-products of their projects, such as communication, affect, and involvement 
(15 percent). Their comments in this category Included such statements as teachers are 
communicating positively.' and *a large percentage of the staff are Involved.' Specific statements 
about governance (8 percent), goal setting activities (8 percent) and evaluation (0 percent) were 
not mentioned frequently as successful features of the SIPD projects. 

Project outcomes (29 percent) were the most frequently mentioned least successful features of the 
SIPD projects. These comments reflected both a lack of success or a lack of progress In 
Implementation of some feature. Other areas that were mentk)ned as least successful features 
Included staff involvement (19 percent), time or energy required to partteipate (18 percent), and 
type of or procedures for staff development and mini-grants (12 percent), it is Interesting to note 
that project outcomes were mentkNied as most successful and least successful in about the same 
proportion of responses. Communications, affect, and involvement received slightly more 
mentions as a least successful feature, than as a mosf successful feature. 

The most frequently mentioned suggestions for changes in the SIPD projects involved time and/or 
energy requirements (24 percent). Project outcomes (17 percent), administrative constraints such 
as reporting requirements and budget prohibitions (18 percent), and communication, affect, and 
Involvement (15 percent) were also mentioned as possible project changes. 
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Table 22. 
SIPD Questionnaire Scales 

Seal« Nam* Pall Quaitionnaira Spring Quattionnaira 

Itama Itama 



1. Outcomes 98-111 30-43 

2. Project Success 64-74 

3. Goal Setting/Pre-SIPD 28.44,46.50,56.58,62 

4. Goal Setting/Fall 29,45,47,51,57,59,63 

5. Goal Setting/Spring 9.15,17,19,20,22 

6. Professional Growth/Pre-SIPD 22.30.38,66,68,74 

7. Professional Growth/Fall 23.31.39.67.69.75 

8. Professional Growth/Spring 10,13.24.25.28 

9. Site Collaboratlon/Pre-SIPD 8.10.12.20.32 

10. Site Collaboration/Fall 9.11.13.21.33 

1 1 . Site CollatMration/SprIng 4.5.6.8. 11.16 

12. Site Committee Leadership 125.126.129.130 53.54.57.58 

13. Principal Leadership 43.61.77,118.131 3.7.21.14.29.47.59 

14. School Cllmate/Pre-SIPD 6.14,16.18.24.26 

46.48.54 

15. School Climate/Fall 7.15.17.19.25.27.41 

49.55 

16. Personal Involvement 112-117.119-124.127. 44-46.48-52.55. 

in SIPD 132.133 60-63 
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